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ABSTRACT 


Nonlinear  real-time  optical  processing  on  spatial  pulse  frequency 
modulation  has  been  pursued  through  the  analysis,  design,  and  fabrication  of 
pulse  frequency  modulated  halftone  screens  and  the  modification  of  micro- 
channel  spatial  light  modulators  (MSLMs) .  Micro-channel  spatial  light 
modulators  are  modified  via  the  Fabry-Perot  method  to  achieve  the  high  gamma 
operation  required  for  non-linear  operation.  Real-time  nonlinear  processing 
was  performed  using  the  halftone  screen  and  MSLM.  The  experiments  showed  the 
effectiveness  of  MSLM  in  its  thresholding  operation  and  also  showed  the  needs 
of  higher  space  bandwidth  product  (SBP)  of  the  MSLM  for  image  processing. 

The  Hughes  LCLV  has  been  characterized  and  found  to  yield  high  gamma 
(about  1.7)  when  operated  in  low  frequency  and  low  bias  mode.  Cascading  of 
two  LCLVs  should  also  provide  enough  gamma  for  nonlinear  processing.  In  this 
case,  the  SBP  of  the  LCLV  is  sufficient  but  the  uniformity  of  the  LCLV  needs 
improvement . 


The  LCTV  SLM  has  been  found  useful  in  a  number  of  interesting  real-time 
optical  processing  applications.  These  include  image  correlation,  computer- 
generation  of  holograms,  pseudo-color  image  encoding  for  image  enhancement, 
and  associative-retrieval  in  neural  processing. 

The  discovery  of  the  only  known  optical  method  for  dynamic  range  com¬ 
pression  of  an  input  image  in  real-time  by  using  GaAs  photorefractive  crystals 
is  reported. 


Finally,  a  new  architecture  for  non-linear  multiple  sensory, 
processing  has  been  suggested  for  future  work. 
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PREFACE 


Real-time  optical  Image  processing  Is  an  Important  technique  for 
military  and  on-board  space  applications  such  as  the  guidance  and  homing  of 
missiles,  and  vision  systems  for  space  station  robotics.  Compact, 
lightweight,  and  high  speed  Image  processors  are  useful  for  on-board  military 
surveillance,  natural  resources  recognition,  and  space  data -reduct Ion  and 
analysis . 

For  this  purpose,  a  research  project  on  real-time  optical  Image  process¬ 
ing  techniques,  supported  by  the  Army  Research  Office  in  Durham,  N.C.,  was 
performed  at  the  Jet  Propulsion  Laboratory. 

This  final  technical  report  Is  based  nn  the  work  performed  during  the 
contract  period.  A  total  of  around  10  publications  have  been  credited  fully 
or  partially  (as  co-sponsor)  to  this  ARO  contract.  The  areas  of  the  publica¬ 
tions  embraced  halftone  screen  design,  analysis,  and  fabrication;  spatial 
light  modulator  research  and  development;  real-time  optical  processing  experi¬ 
ments;  and  new  architectures  for  neural-net  processing.  A  total  of  around  10 
researchers  from  JPL  and  academia.  Including  the  University  of  Southern 
California,  the  University  of  Alabama,  California  State  University  at  San 
Diego,  and  the  Massachusetts  Institute  of  Technology,  have  been  partially  sup¬ 
ported  by  this  project.  One  Ph.D  thesis  and  one  Master's  thesis  have  resulted 
due  to  the  partial  support  of  this  project. 

The  final  report  Is  organized  In  a  way  that  essential  results  are 
properly  integrated  and  placed  In  proper  perspective  with  reports,  reprints, 
and  preprints  of  publications  appendlxed  for  easy  reference. 
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EXECUTIVE  SUMMARY 


In  the  field  of  real-time  optical  image  processing,  an  essential  optical 
component  is  the  spatial  light  modulator  (SLM) .  SLMs  can  be  used  for  input¬ 
ting  2-D  images  in  real-time,  for  forming  spatial  filters,  and  for  recording 
computer  generated  holograms.  Before  the  invention  of  the  SLM,  silver  halide 
films  were  used  to  perform  these  functions,  but  the  processing  was  done  in  a 
darkroom  in  a  non  real-time  mode,  i.e. ,  the  film  had  to  be  developed  and  fixed 
before  it  was  useful. 

Although  film  has  many  advantages,  such  as  its  high  resolution  (-  2000 
lines  per  millimeter)  and  proper  contrast  for  optical  processing,  the  time- 
delay  resulting  from  the  darkroom  process  renders  the  phrase  "processing  with 
speed  of  light"  totally  meaningless.  Therefore,  a  major  objective  of  the 
research  reported  here  is  to  determine  how  one  can  do  real-time  optical 
processing  through  the  proper  development  and  application  of  SLMs. 

Optical  processing  may  be  classified  into  two  types,  according  to  the 
relationship  between  the  input  and  the  output.  If  the  output  is  representable 
as  a  linear  superposition  of  the  input,  the  processing  is  said  to  be  linear. 

Linear  optical  processing  has  been  known  for  several  decades.  An  ex¬ 
ample  is  the  removal  of  additive  noise  through  a  linear  spatial  filtering 
operation.  In  contrast  to  linear  processing  is  nonlinear  processing.  For  ex¬ 
ample,  if  the  noise  and  signal  are  multiplied  in  the  input,  they  can  only  be 
separated  via  a  type  of  nonlinear  processing  called  logarithmic  filtering. 

Nonlinear  processing  was  explored  in  the  late  1970’ s.  One  of  the  most 
successful  techniques  for  nonlinear  processing  is  the  halftone  method.  In 
this  method,  the  image  is  first  copied  through  a  halftone  screen  onto  a  high- 
gamma  (high  contrast)  film,  in  a  manner  similar  to  that  of  the  printing 
process.  The  developed  film  is  called  the  halftone  transparency.  When  the 
halftone  transparency  is  placed  at  the  input  of  a  coherent  optical  processing 
system,  many  interesting  phenomena  may  occur  at  the  output  plane.  These  in¬ 
clude  the  level-slicing  and  equi-density  plot  of  the  input,  and  the  pseudo¬ 
coloring  of  a  black-and-white  picture.  Subtle  differences  in  gray  levels  in 
the  input  can  be  detected  via  these  techniques.  The  applications  of  these 
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techniques  for  industrial  Inspection,  medical  diagnosis,  natural  resource 
identification,  and  military  surveillance  are  apparent. 

The  final  report  has  documented  the  essential  findings  of  the  research 
focused  on  real-time  nonlinear  optical  processing.  The  report  is  divided  into 
three  parts,  all  sharing  the  common  objective  of  developing  a  real-time 
processing  technology.  The  first  part  is  the  characterization  and  development 
of  SLKs.  The  second  part  is  the  design,  analysis,  and  fabrication  of  specific 
halftone  screens  suitable  for  optical  processing.  The  third  part  is  the  per¬ 
formance  of  real-time  nonlinear  processing  and  the  research  and  development  of 
new  optical  processing  architectures  based  on  the  progress  made  in  the  first 
two  parts.  More  details  of  the  results  obtained  in  these  three  parts  are  sum¬ 
marized  below. 

(1)  SIK  characterization  and  development 

The  micro -channel  Slit  (MSLH)  has  been  investigated  in  the  following 
areas:  (a)  conversion  of  the  standard  SLM  to  a  Fabry-Perot  MSLM  for  high- 
gamma  operation,  (b)  operation  of  the  MSLM  in  a  closed- loop  feedback  con¬ 
figuration.  (c)  operation  of  the  MSLM  in  the  electron  deposition/ grid  stabi¬ 
lized  mode,  and  (d)  operation  in  the  real-time  hard-clipped  mode.  It  has  been 
found  that  the  MSLM  can  achieve  very  high  contrast  (high  gamma).  However,  as 
the  MSLM  device  available  for  our  experiment  had  limited  spatial  band-width 
product  and  lack  of  uniformity,  other  SIMs,  such  as  the  Hughes  LCLV,  have  also 
been  characterized. 

The  operation  of  the  Hughes  LCLV  is  described  below.  The  birefringence 
of  the  liquid  crystal  (LC)  is  controlled  by  a  writing  beam  incident  on  the 
writing  side  and  the  voltage  across  the  photoconductor  and  the  LC  layers.  In 
the  reflecting  mode  of  operation,  the  output  is  reflected  from  the  reading 
side  of  the  devfce  through  the  polarization  modulation  by  the  liquid  crystal 
layer.  It  has  been  found  that  the  gamma  of  the  SIM  may  be  increased  from  1  to 
1.7  when  the  LCLV  is  biased  at  lower  frequencies  and  lower  voltages  than  those 
suggested  by  its  manufacturer  for  normal  operation.  However,  in  this  mode, the 
speed  of  operation  is  reduced.  Cascading  of  two  LCLVs  may  provide  enough  high 
gamma  for  nonlinear  processing. 
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For  the  Inputting  requirement,  inexpensive  electronically  addressable 
liquid  crystal  televisions  (LCTVs)  have  been  investigated  for  optical  process¬ 
ing.  The  LCTV,  after  proper  modification,  can  be  used  as  an  SLM  for  many  op¬ 
tical  processing  applications,  such  as  pattern  recognition,  pseudo-color  en¬ 
coding,  logic  operations,  and  computer -generated  holograms.  In  Its  transmis¬ 
sion  mode,  the  LCTV  SLM  can  modulate  both  the  amplitude  and  phase  of  an  Input 
via  polarization  rotation  of  the  liquid  crystal  controlled  by  the  applied 
electric  field. 

(2)  Halftone  screen  design,  analysis,  and  fabrication 

As  mentioned,  the  halftone  screen  technique  can  be  used  for  operations 
such  as  logarithmic  transformation,  exponentiation,  level  slicing,  multiple 
Isophote  generation,  quantization,  pseudo-color  encoding,  A-D  conversion. 
Image  subtraction,  and  multiple  Image  storage.  All  these  techniques  have  been 
demonstrated  In  the  non- real -time  mode.  In  this  part  of  the  research,  the 
pulse -angular -frequency  modulation  principle  has  been  used  for  the  design  of 
the  screen.  In  the  fabrication  process,  one -dimensional  masks  are  fabricated 
first,  and  2-D  screens  are  then  made  from  the  1-D  masks.  The  expected  output 
at  the  Fourier  plane  has  to  be  mathematically  analyzed.  The  2-D  screens  can 
be  used  for  histogram  measurement,  density  slicing,  and  density-based  artifi¬ 
cial  stereo  transformation. 

(3)  Real-time  nonlinear  processing  and  new  architectures 

The  specifically  designed  halftone  screens  have  been  used  with  an  Input 
Image  in  a  coherent  optical  processing  system  with  an  HSIM  as  the  nonlinear 
thresholding  device  to  achieve  the  nonlinear  processing  operation.  It  has 
been  discovered  that  real-time  halftone  effects  can  be  obtained  through  this 
system.  Hard  dots  of  various  sizes  have  been  yielded.  The  only  problem  Is 
that  the  HSLM  has  a  limited  region  of  uniform  aperture  and,  therefore,  the  to¬ 
tal  SB?  is  not  sufficient  for  further  spatial  filtering  operations. 

Three  ideas  have  been  conceived  for  solving  this  problem.  One  is  to 
continue  to  develop  MSLMs  which  would  achieve  high-gamma  high  SBP  results. 
The  second  is  to  use  the  Hughes  LCLV  in  a  cascaded  mode.  The  third  is  to 
utilize  the  high  contrast  capability  of  a  photorefractlve  crystal,  such  as 
BaTiO^  for  the  thresholding  operation. 
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In  the  investigation  of  real-time  processing,  new  architectures  for  fu¬ 
ture  investigation  have  been  developed.  These  Include: 

(a)  array  architectures  for  edge  detection  feature  extraction  and  for 
median/rank  order  filtering  used  in  image  enhancement; 

(b)  array  architectures  using  artificial  neural  networks  (ANNs)  for 
image  restoration  and  pattern  recognition; 

(c)  array  architectures  for  Kalman  filtering  for  least  square  image 
restorer ion/recons  true  t ion . 

In  addition,  a  proposal  on  multi-sensory  neural  processing,  based  on  the  opti¬ 
cal  implementation  of  the  adaptive  linear  neural  (ADALINE)  system  and  the  mul¬ 
tiple  ADALINE  (MAOLINE)  system,  has  been  written.  The  objective  is  to  use 
these  neural  systems  to  perform  logic  functions  and,  eventually,  distortion 
invariant  pattern  recognition. 
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I. 


INTRODUCTION 


In  performing  real-time  optical  processing,  an  essential  optical  com¬ 
ponent  is  the  spatial  light  modulator  (SLM) .  The  SLM's  are  necessary  for  the 
provision  of  real-time  input,  real-time  processing,  and  spatial  filtering  with 
computer - generated  holograms  or  joint  transform  filters.  In  performing  non¬ 
linear  optical  image  processing,  an  optical  component  is  needed  to  map  an  in¬ 
put  to  an  output  with  a  nonlinear  function.  Among  all  the  devices  that  can 
provide  such  nonlinear  mapping,  it  has  been  shown  that  the  halftone  screen, 
which  has  been  well  known  in  the  printing  industry,  is  a  highly  versatile  and 
flexible  component.  A  major  objective  of  this  research  is  to  evaluate  and 
develop  real-time  nonlinear  optical  image  processing  through  the  incorporation 
of  spatial  light  modulators  with  specifically  designed  halftone  screens . 

Another  major  objective  of  the  research  is  to  use  existing  SLM's  to  per¬ 
form  real-time  image  processing.  In  addition,  by  the  end  of  the  contract,  it 
is  expected  that  new  real-time  optical  processing  architectures  will  have  been 
discovered. 

We  have  performed  work  focused  on  the  above -stated  major  objectives.  In 
the  spatial  light  modulator  area,  the  mlcrochannel  spatial  light  modulator 
(MSLH)  has  been  developed  through  a  sub-contract  with  the  Massachusetts  In¬ 
stitute  of  Technology  (MIT) .  The  goal  is  to  achieve  high  contrast  (i.e. ,  high 
gamma)  operation  in  the  HSIM  for  optical  thresholding  in  real-time  which  is 
important  for  both  non-linear  image  processing  and  the  recently  developed  op¬ 
tical  neural  networks.  Other  SLM's  that  we  investigated  include  the  newly 
discovered  liquid  crystal  television  SLM's,  and  the  Hughes  and  Loral  (Xerox) 
liquid  crystal  light  valves.  Ve  have  characterized  these  SLM's  with  respect 
to  their  aspects  of  applications  In  non-linear  image  processing. 

In  the  halftone  screen  part,  we  have  analyzed  the  design  and  performance 
of  a  special  screen  which  is  able  to  make  pulse- frequency  modulation  and 
analysis  of  an  input  luge.  Optical  mthods  have  been  devised  for  uking  this 
type  of  screen  and  examples  are  provided. 

In  real-time  halftone  nonlinear  processing,  ve  have  used  the  halftone 
screen  In  combination  with  the  MSLN  and  showed  that  halftone  dots  can  be  ob¬ 
tained  In  real-tlu.  The  NSLM,  due  to  Its  limited  number  of  SBP  and  resolu¬ 
tion,  can  only  provide  localized  halftone  modulation.  In  order  to  do  larger 
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image  halftoning,  we  have  also  experimented  with  the  Hughes  LCLV  in  its  high- 
gamma  mode.  Ue  recommend  for  future  research  that  the  high  gamma  nature  of 
photorefractive  crystals  be  explored  for  the  thresholding  operation. 

Finally,  we  have  suggested  as  an  extension  of  real-time  optical  process¬ 
ing,  the  optical  implementations  of  multi-sensory  adaptive  neural  processing 
for  linear  and  nonlinear  data  separation,  logic  operations,  heteroassoclative 
mapping  for  data  reduction,  and  distortion  invariant  pattern  recognition.  The 
new  architecture  has  many  unique  features  which  include  the  elimination  of 
spurious  states  and  the  addition  of  the  controllability  of  basins  of  attrac¬ 
tion  for  generalization.  More  importantly,  we  propose  to  use  the  various 
SLM's  such  as  the  MSLM,  LCTVSLK,  and  Hughes'  LCLV  for  the  inputting  and 
thresholding  operation  In  real-time  neural  processing. 

II.  HALFTONE  TECHNIQUES  FOE  SPATIAL  FOLSE -FREQUENCY  MODULATION 

Optical  coding  or  modulation  techniques  have  been  proven  useful  for  many 
image  processing  applications.  The  commonly  seen  techniques  Include  linear 
modulations  of  an  Image  by  using  Ronchl  rulings^  or  sinusoidal  gratings,^  and 
spatial  pulse-width  modulation  by  contact  screens.^  Based  on  these  tech¬ 
niques,  operations  such  as  logarithmic  transformation,^*^,  exponentiation,^’^ 

level  slicing,  ’  multiple  isophote  generation,  ’  quantization, 

11  ft  12  1  11 
pseudocolor,  A-D  conversion,  ’  subtraction,  ’  and  multiple  image 

storage^  can  be  realized.  The  one-dimensional  (1-D>  optical  pulse -frequency 
modulation  technique  has  been  developed  by  Indebetouw  In  achieving  pseudo¬ 
color^^  and  by  Soffer,  gX  In  achieving  real-time  level  slicing  through  the 
variable  grating  mode  liquid  crystal  (VOfLC).^^  In  addition,  Schneider^^  has 
made  a  special  contact  screen  for  pulse  azimuth  modulation. 

We  have  investigated  a  special  two-dimensional  (2-D)  optical  pulse  fre¬ 
quency  modulation  technique  that  can  be  used  to  achieve  histogram 
measurement,  density  slicing,  ^  density-based  artificial  stereo,  '  and  gray 
level  image  enhancement.^^  He  have  introduced  angulsr  and  spatial -frequency 
transmittance  variations  into  the  cell  patterns  of  the  2-0  contact  screens. 

In  the  following,  an  analysis  of  the  screen  is  shown  with  the  illustra¬ 
tion  of  an  example.  A  photograph  of  the  screen  made  by  the  technique  is  also 
presented. 
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2-1  DESIGN  AND  ANALYSIS  OF  THE  SPECIFIC  SCREEN 


We  present  a  theoretical  analysis  of  the  halftone  technique  with  an  il¬ 
lustrative  example  and  experimental  result  as  follows . 

2-1-1  Screen  Design 

21 

First,  a  one -dimensional  contact  screen  is  fabricated  with  its  trans¬ 
mittance  pattern^^  of  its  unit-cell  T®(x)  shown  in  Fig.  1.  The  modulation 
process  is  accomplished  by  contact-printing  the  original  image  through  the 
screen  onto  a  (positive  or  negative)  high  (infinite  to  be  ideal)  gamma  film. 

Assume  that  the  frequency  of  the  contact  screen  is  sufficiently  high  so 
that  within  the  region  of  any  one  unit-cell  of  the  screen  the  transmittance  T 
of  the  image  transparency  is  constant.  Moreover,  we  define  ■  I^'^/Iq  where 
I^^  is  the  threshold  intensity  of  the  hi^  gamma  film  and  1^  is  the  intensity 
of  the  uniform  source  of  illumination.  If  the  image  transmittance  (of  a 
transparency)  T  <  the  corresponding  unit-cell  region  of  the  developed 

film  will  have  a  transmittance  of  nearly  1  in  case  a  negative  film  is  used. 
This  corresponds  to  a  zero  spatial  frequency,  i.e.,  f^  -  0.  Likewise,  for 
T^Vt2  >  T  2:  T^Vt^,  fjj  -  1/X;  for  t’^Vt3  >  T  i  t'^Vt2  ,  f^  -  2/X:  .  .  .  and 
for  T  >  T*=^/T4.  -  8A-  Thus  the  image  in  the  developed  film  is  frequency- 

modulated  . 

2-1-2  Optical  Image  Processing  -  intensity  histogram:  image  enhancement: 

pseudo -color:  and  artificial  stereo. 

If  the  developed  film  is  a  transparency,  it  can  be  placed  at  the  input 
plane  of  a  conventional  coherent  optical  image  processing  system  as  shown 
in  Fig.  2.  At  the  Fourier  plane  of  the  system,  the  diffraction  spot  at  spa¬ 
tial  frequency  coordinate  u  -  fA  1/X  contains  the  image  information  where 
T*’^/T2  >  T  i  where  f  is  the  focal  length  of  the  Fourier  transform  lens 

and  A  is  the  wavelength  of  point  source  S.  Similarly,  the  spot  at  u  •  fA 
2/X  contains  the  image  information  of  T^^'/Tj  >  T  >T^^/T2,  etc.  Several  ex¬ 
periments  can  than  be  performed.  First,  after  the  light  intensities  of  these 
spots  are  measured,  a  histogram  of  the  original  image  can  be  obtained  in  a 
straight-forward  manner.  Second,  if  different  neutral  density  filters  are 
placed  behind  those  spots  and  all  other  diffraction  orders  are  stopped,  the 
output  image  on  the  plane  P2  will  be  changed  with  respect  to  the  input  image. 
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Figure  1.  The  trensalttance  o£  a  unlt>cell  of  a  specific  contact 

screen  for  pulse -frequency  nodulacion 
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For  example,  if  the  density  filters  have  lower  densities  for  the  portions  with 
higher  T,  the  image  contrast  will  be  enhanced.  Third,  if  a  white  light  source 
is  used  instead  of  the  monochromatic  source,  and  a  set  of  color  filters  are 
placed  at  the  Fourier  plane  to  selectively  pass  certain  colors,  a  pseudo - 
colored  image  can  therefore  be  obtained.  Finally,  if  a  set  of  optical  wedges 
with  different  wedge  angles  are  placed  behind  these  diffraction  spots,  artifi¬ 
cial  stereo  pictures  can  then  be  obtained. 

2-1-3  Cross-Talk  Elimination  with  Specific  Screen  Design 

It  should  be  pointed  out  that  owing  to  the  cell  pattern  shown  in  Fig .  1 , 
the  diffraction  order  with  f^  -  2/X  overlaps  with  the  second  harmonic  of  the 
diffraction  order  with  f^  -  1/X.  The  overlapping  becomes  more  serious  at 
higher  frequencies.  As  a  consequence,  crosstalk  among  different  transmit - 
tances  in  the  image  would  occur. 

To  avoid  the  crosstalk  problem,  a  new  two-dimensional  contact  screen 
with  typical  cell  patterns,  e.g.,  as  shorn  In  Fig.  3  should  be  designed.  In 
Fig.  3,  a  unit  cell  consists  of  three  columns  denoted  by  A,  B  and  C,  where  T^^, 
T2,  T3,  and  T^  in  the  parallelograms  represent  the  corresponding  local  trans- 
mlttances.  Such  a  screen  can  be  produced  by  exposing  a  high- resolution  fresh 
low- gamma  film  covered  with  two  masks;  one  of  which  is  a  periodic  1-D  thin- 
slit  mask  (say  Mask  No.  1)  with  period  X  and  slit-width  X/3.  The  other  one  is 
also  a  periodic  1-D  thin-slit  mask  (say  Mask  No.  2)  with  period  X' (which  may 
or  may  not  be  equal  to  X)  and  slit-width  X'  /2 .  In  obtaining  the  patterns 
shown  in  Fig.  3,  six  exposures  should  be  made.  The  first  exposure  is  for  get¬ 
ting  Tj^  in  the  parallelograms  in  columns  marked  by  A.  During  the  ex¬ 
posure,  the  slits  on  the  two  masks  are  placed  perpendicular  to  each  other. 
The  second  exposure  is  for  T2  in  the  ”T2”  parallelograms  in  column  A.  It  is 
made  after  mask  No.  2  is  shifted  by  a  distance  X'/2  along  the  direction  per¬ 
pendicular  to  its  slit  lines.  A  third  exposure  is  made  after  mask  No.  1  is 
shifted  a  distance  X/3  perpendicular  to  its  slit  lines  and  mask  No.  2  is 
rotated  by  an  angle  6^,  and  T2  in  the  "T2"  parallelograms  of  column  B  can  be 
recorded.  The  processes  in  getting  the  transmittances  in  the  other  paral¬ 
lelograms  are  similar  to  the  steps  described  above. 

When  the  screen  with  cell  patterns  shown  in  Fig.  3  is  used  for  modulat¬ 
ing  an  original  image,  a  freqtiency-modulated  image  can  then  be  obtained.  In 
this  case,  however,  the  differences  among  various  frequencies  are  not  their 
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moduli  but  their  azimuths.  The  cross-talk  problem  can  be  avoided  if  the 
separations  among  the  frequencies  of  the  masks  are  sufficient  and  the  angle  of 
the  rotation  between  the  two  masks  are  adequate.  The  zero  and  first  order  of 
the  Fourier  spectrum  of  the  modulated  image  would  look  like  that  as  shown  in 
Fig.  4,  where  u-axis  and  v-axis  are  the  spectral  coordinate  axes  corresponding 
to  X,  y  axis  on  the  modulated  image.  The  spectriom  spots  denoted  by  "0",  "x" , 
and  are  corresponding  to  columns  A,  B,  and  C  and  relate  to  the  ranges  of 
transmittances,  T^Vt^  <  T  <  T^Vt^,  T^*'/T3,  and  T^^/T3  <  T  <  T^*'+/T4  respec¬ 
tively.  All  the  diffraction  orders  except  the  ones  located  on  the  u-axis  can 
be  used  for  separately  modifying  the  different  transmittance  components  of  the 
original  image  without  suffering  from  any  cross-talk.  In  general,  more  trans¬ 
mittance  levels  can  be  discriminated  or  frequency -encoded  if  there  are  more 
columns  in  a  unit  cell  as  shown  in  Fig.  5. 

2-1-4  Math«a«tlcal  Analyata 

The  simple  example  described  above  is  only  for  the  illustration  of  the 
basic  idea  of  the  pulse -frequency  modulation  technique.  Details  of  a  more 
general  2-D  analysis  are  presented  below. 

Ve  assume  that  the  general  screen  function  f(x,y)  can  be  Illustrated  in 
Fig.  5,  where  X  is  the  period  of  a  first  slit  mask.  The  slits  in  the  mask  are 
assumed  to  be  oriented  along  the  y-axls.  Ve  further  assume  that  the  number  of 
distinguishable  gray  levels  is  N. 

Ve  may  consider  the  whole  screen  pattern  as  a  sum  of  N  sets  of  peri¬ 
odical  strips.  The  n^^  set  can  be  expressed  by  p^  x  7^,  where  p^  is  a  verti¬ 
cal  granting  as  shown  In  Fig.  6  with  its  period  x  and  its  slit-width  X/N,  the 
positions  of  the  slits  for  p^^  relative  to  those  for  P]^  are  shifted  along  x 
axis  by  a  quantity  (n-1)  X/N  ;  7^  is  an  inclined  grating  made  by  a  second  slit 
mask  as  shown  in  Fig.  7.  Its  period  is  X'.  The  angle  of  inclination  is  6^. 
Within  any  one  grating  period,  there  are  two  different  transmittance  levels, 
Tn  and  Vl-  each  of  which  occupies  one  half  width  of  the  period.  Ve  have 


f(x,y) 


|.lPn<x.y,)  *  7n(x,y) 


(1) 
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Figure  5. 
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A  diegru  for  illustretlng  tho  coll  pottern  of  a  typical 
gonaral  2-D  pulso* frequency  nodulation  screen 
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Notice  that 


-  0  for  m  n 

at  any  point  (x,y,).  The  Fourier  transform  of  f(x,y),  F(u,v)  is 
F(u,v)  -  |^^pj^(u,v)  *  Rjj(u,v) 


(2) 


(3) 


where  p^^  and  are  the  Fourier  transforms  of  Pj^  and  7^  respectively,  * 
denotes  convolution,  and  u,v  are  spatial  frequencies  corresponding  to  x,y. 

The  mathematical  expressions  of  the  functions  involved  are  described  as 
follows ; 


(a)  Pn(*.y)  and  Pjj(u.vJ 


n-1 

Pn  -  rect  ( - -  )  * 

N 


i  -  i)  «(y) 


(4) 


For  simplicity,  we  will  hereafter  write 


as  Z  , 


/ 

X— « 


as 


f  ,  etc. 
x 


The  2-D  Fourier  transform  of  is; 


PnCn."^)  “  -jj  sinc<-  u)  e 


x«(v)  «  5  i  «(U  ■  i> 


-  g  H  •‘'“<g>  • 


i  i 

6(u  -  -)  fi(v) 


(5) 


(b)  rj^(x.y)  and  R^jCu.v) 
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» .^”7  -a 


We  first  express  r^^  as  shown  in  Fig.  8  in  (x^,  y^)  coordinates  by 

‘'n'  (’S-yn>  -  '^n<’^-y> 

It  is  obvious  that: 

-  {Tn  rect  (^)  +  Vilrect  (^)  -  rect  (^)])*S  i  «(|n  .  m)  5(y^) 

-l<Tn  -  Tn+1  <^)  +  Vl  ))*S  -  •”)  «(yn) 

The  Fourier  transform  can  also  be  represented  in  spatial  frequency  domain  (u^, 
Vn)  by 

Vu.v)  -  R'n<‘*n-V 

-  UTn  -  |1  sine  •  X'  sine  (X'u„)]  •  fi(v^) 

-I  i  <Un-=) 

“  S  5  Vl 

-  Z  [(Tj^  -  i  sine  (|)  +  sine  (m)  ]  fi(u  sinS^^  -  v  cosS^  '  ^  • 

5(u  cos9jj  +  V  sln6^  (m) .  (8) 

The  last  step  is  resulted  from  a  coordinate  conversion.  After  rearranging  the 
two  5 -functions,  we  have 

Rj^(u,v)  -  Z[(T„  -  T„^.j^)  i  sine  (|)  +  T^+i  sine  (m)]  «(u  -  ^.sinB^) 

X  «(v  +  j,cosej^).  (9) 


13 


Notice  that  the  function  sine  (— )  has  non-zero  value  only  for  m  -  0  and  m  - 
odd  integers,  and 


sine  (m)  -  ( 


1  m  -  0 
0  otherwise. 


The  Fourier  spatial  frequency  spectrum  of  the  screen  is  analyzed  below. 
For  convenience ,  let 


As  a  consequence, 

Fn(u,v)  -  Pn(u,v)  *R„(u.v) 


B„(m)«(u'  -  =,sln0n)  5(v'  +  ^j.cose^J 


u' ,v'm 


X  [J  A(f,n)  5(u  -  u'  +  -)  «(v  -  v')]  du'dv' 

-  ^  A(i,n)  B„(m)  /  «(u'  -  l.sine^)  fi(v  +  |,co8e„)  «(u  -  u'  +  ^)  du' 


i  m 


-  g  A(i,n)  B„(m)  S  («  +  j  x.®o*®n> 
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Th«  posiciona  of  cha  zero  and  firsc  orders  of  these  spectral  componencs  are 
shovm  in  Fig.  9.  The  positions  and  the  F^^  values  of  several  orders  are  lisced 
in  Table  I. 


TABL£  I.  Aoplitudes  and  Posiciona  of  the  Fourier 

Spectra  of  the  Screen. 


(i.m) 


Position  (u,v)  F_ 


sin6_  coad. 
-  X'  ■+  X' 


A(0,n)  Bj^(O) 


A(±l,n)Ba(0) 


211  ^^n  “*■  ^n+1^ 


n-1 

2ii^^n  "*■  *iric(-)e 


A<0.n)B„(l)  -  -(T^  +  T„^l) 


^  -  1  -  COSS_ 

±1,±I  —-'—a  4.-4.  .  B 

“  ”  -  X'  +  X'^  X' 


A(±l.n)B„(±l)  -  _(T„  .  Tn+l)  sinc(-)e 


1 


o.±2  ±  A(O.n)  B„(±2)  -  0 

±1.±2  ±  A(±  l.n)  B^(+2)  .  0 


Ic  is  easy  co  find  ouc  chac  Just  u  one  expected,  all  positions  of  the 
spectra  are  located  at  a  set  of  parallel  lines  chat  are  Inclined  to  v*axis  by 
angle  and  separated  vlch  each  ocher  by  a  distance  1/X  along  u-axls.  The 
locations  of  the  spectra  on  each  of  the  parallel  lines  are  exactly  the  seme  as 
chose  of  Che  spectrua  of  r^(x,y). 

Based  on  Eq.  (13),  the  whole  spectrua  of  the  screen  is  a  suaaacion  of 
All  Pq'a  (0*1,2, ...  ,N}  .  That  aeane  all  spectral  coaponencs  are  located  on  a 
group  of  parallel  line  secs,  end  under  a  careful  arrsngeaent,  no  coaponencs  of 
low  orders  (such  as  lower  chan  the  7®*  order,  for  practical  applications, 
higher  orders  are  useless  because  of  their  trivial  intensities  and  first  or* 


15 


d*rs  ar«  enough  for  mosc  cases)  excepc  che  zero*order  are  specially  colncidenc 
wich  others.  Figures  3  and  4  show  an  example  with  M  -  3,  where  che  columns  A. 
B  and  C  correspond  to  n  -  1.2  and  3,  respectively,  and  9^  •  0,  3^  ~  ®3  ~ 
0(..  The  locations  of  che  rero  and  first  orders  of  F(u,v)  as  shown  In  Fig.  4 
can  be  determined  based  on  Eqs.  (12),  (13)  and  (14). 

The  spectrum  of  che  pulse>frequency>modulaced  image  is  analyzed  as  fol¬ 
lows-.  After  an  input  image  is  contact -printed  onto  a  high  gamma  film  through 
che  above -described  screen,  a  pulse -frequency  modulated  (or  encoded)  image 
(transparency)  is  obtained.  The  spectrum  of  che  encoded  image  at  che  Fourier 
plane  of  a  Fourier  transform  lens  is  similar  to  but  different  from  che 
spectrum  of  che  screen  in  two  aspects.  (1)  Each  order  is  no  longer  a  sharp 
poinc-lilce  spot  but  is  somewhat  smeared  out.  The  sizes  of  the  smeared 
spectral  islands  depend  on  che  size  of  che  smallest  area  on  che  original  image 
where  che  transmittance  is  between  T^  and  Vl  if  a  monochromatic  point  source 
is  used  in  che  optical  transform  system.  A  broadening  of  che  size  and  band 
width  of  the  light  source  will  further  spread  che  size  of  che  island,  (b)  The 
energy  distribution  among  the  various  orders  of  che  spectrum  of  che  encoded 
image  is  different  from  chat  of  che  screen.  This  is  due  to  che  following 
reasons:  (i)  The  encoded  image  is  binary  but  the  screens  have  many  gray 
levels.  Thus  che  spectral  coefficients  of  are  different  for  che  evo 
cases,  (ii)  The  relative  energy  ratios  among  different  n  value  is  also  dif¬ 
ferent  for  che  two  cases.  For  che  screen,  che  distribution  is  fixed,  but  for 
che  encoded  image,  it  depends  on  che  gray  level  distribution  (histogram)  of 
the  original  image.  For  example,  if  nowhere  of  che  original  image  has  a 
transmittance  value  between  Tj|  and  Chen  che  corresponding  spectrum  order 
of  che  encoded  image  will  disappear. 

Although  Che  useful  spectral  orders  of  che  encoded  image  are  smeared, 
cheir  centers  are  definitely  separated  in  space.  So,  the  total  overlap  for 
che  spectral  components  of  different  gray  levels  happening  in  che  1-0  screen 
case,  as  we  mentioned  above,  does  not  happen  in  che  2-D  screen  case.  Conse¬ 
quently,  a  2-0  screen  can  be  designed  to  separate  che  spectral  spots  of  its 
encoded  imago  and  eliminate  cross-talk.  To  achieve  che  optimum  screen  design, 
factors  such  as  the  size  and  bandwidth  of  che  li^c  source,  che  number  of  dis- 
cinguishable  gray  levels,  and  che  spatial  frequency  of  Che  original  image 
should  be  carefully  considered. 
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2-2 


Experimental  Demonstration 


To  fabricate  the  specific  halftone  screen,  a  Ronchl  Ruling  Is  used  to 
fabricate  the  mask  to  be  placed  on  a  Kodak  649F  glass  plate.  On  the  mask  is  a 
periodic  pattern  In  both  x  and  y  directions.  Within  each  period  Is  a 
transparent  square  with  opaque  background.  Each  side  of  the  square  Is  X/6 
Inches,  where  X  Is  the  period  of  Ronchl  Ruling.  A  x-y  translation  stage  was 
used  to  move  the  glass  place  underneath  the  mask. 

To  fabricate  a  300  Ipl  screen,  a  300  Ipl  Ronchl  Ruling  was  used  to 
fabricate  the  mask  on  a  4"  by  5"  Kodak  649  glass  plate.  On  the  mask  Is  a  pe¬ 
riodic  line  pattern  with  a  period  of  1/300  Inch  in  the  x  direction.  The  width 
of  the  transparent  line  Is  about  1/4000  of  an  Inch.  A  translation  stage  is 
used  to  push  the  mask  which  sits  on  top  of  the  glass  plate.  The  plate  was 
fixed  on  a  platform  adjacent  to  the  translation  stage. 

A  translation  stage  was  used  to  push  the  mask  which  sits  on  top  of  the 
glass  plate  with  no  gap  In  between.  The  place  Is  fixed  on  a  platform  adjacent 
to  the  translation  stage.  The  Ronchl  Ruling  remains  on  top  of  the  mask  with 
no  gap  in  between.  A  second  translation  stage  is  used  to  push  the  Ruling  to 
obtain  the  desired  angles. 

Six  exposures  were  made,  two  each  with  the  Ruling  positioned  at  0,  30, 
and  60  degrees,  respectively.  For  each  angle,  after  the  first  exposure,  the 
Ronchl  Ruling  was  pushed  by  1/200  of  an  inch  and  exposed  before  it  was  rotated 
by  30  degrees. 

A  photomicrograph  of  the  screen  cells  that  have  four  different  angular 
orientations  and  10  levels  of  gray  in  each  direction  Is  shown  in  Fig.  10. 
Screens  of  periodicity  ranging  from  50  Ipi  to  300  Ipi  can  be  made  without  dif¬ 
ficulty.  These  screens  can  be  made  to  accomodate  SLM's  of  a  variety  of 
resolution  limits. 
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Figure  10.  A  photomicrograph  of  halftone  screen  cells  designed  for 

pulse  frequency  modulation  applications 
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III.  SPATIAL  LIGHT  MODULATORS  AMD  THEIR  APPLICATIONS  FOR  REAL-TIME  OPTICAL 

PROCESSING 

2  3 

We  have  Investigated  several  SLHs  for  real-time  optical  processing. 
These  are  the  MicroChannel  Spatial  Light  Modulator  (MSLM) ,  the  Hughes  and  the 
Loral  Liquid  Crystal  Light  Valve  (LCLV) ,  and  the  recently  discovered  liquid 
crystal  television  SLM.  For  real-time  processing,  the  input  film  should  be 
replaced  by  an  SLM.  The  optical  thresholding  should  also  be  performed  by  an 
SLM.  These  SLMs  are  described  below. 

3-1  The  MSLM 

The  standard  MicroChannel  Spatial  Ll^t  Modulator  (MSLM)  is  a  versatile, 
real-time  optical  signal  and  image  processing  device  which  exhibits  high  opti¬ 
cal  sensitivity  and  high  framing  speed.  It  consists  of  a  photocathode  and  a 
microchannal  plate  (MCP)  nearly  in  focus  with  an  optical  planar  acceleration 
grid  and  an  electro -optic  crystal  plate,  as  shown  in  Fig.  11.  The  electro - 
optic  plate  carries  a  high  resistivity  dielectric  mirror  on  one  side  and  a 
transparent  conducting  electrode  on  the  other. 

In  the  electron  deposition  write  mode,  Incoherent  or  coherent  write 
light  incident  on  the  photocathode  creates  an  electron  image  which  is 
amplified  by  the  MCP  and  focused  onto  the  surface  of  the  dielectric  mirror. 
The  resulting  spatially  varying  electric  field  modulates  the  refractive  index 
of  the  electro-optic  plate.  Thus,  the  readout  light,  which  makes  a  double 
pass  through  the  crystal,  is  spatially  phased  or  amplitude  modulated  depending 
on  the  crystal  cut  and  readout  scheme  (polarization  or  interferometric) 
employed. 

The  image  is  erased  by  appropriately  adjusting  the  device  voltages  and 
flooding  the  photocathode  with  light  so  that  electrons  are  removed  from  the 
mirror  surface  by  seconda'^  electron  emission.  Alternatively,  the  device  can 
be  operated  in  the  reverse  mode  where  a  positive -charge  image  is  written  by 
secondary  electron  emission  and  erased  by  adding  electrons  to  the  crystal. 
For  Pockels  effect  crystals,  this  leads  to  contrast  reversed  images. 
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The  gamma  of  the  standard  device  Is  too  low  for  application  in  the 
halftone  pulse  frequency  modulation.  To  Increase  the  gamma  of  the  MSLM,  we 
need  to  modify  the  device  by  depositing  mirrors  on  both  surfaces  of  the  crys¬ 
tal  so  as  to  convert  It  to  a  spatially  tunable  Fabry-Perot  etalon.  A  standard 
dielectric  mirror  Is  deposited  on  the  surface  that  received  the  electrons, 
while  a  conducting  mirror  Is  employed  on  the  readout  surface  of  the  crystal . 
The  conducting  mirror  also  serves  the  role  of  the  conducting  electrode. 

The  reason  a  Fabry-Perot  crystal  leads  naturally  to  a  high  gamma  device 
Is  obvious  from  an  examination  of  the  readout  Intensity  characteristic  of  the 
device.  This  characteristic  Is  shown  In  Fig.  12.  There  It  Is  seen  that  the 
output  intensity  becomes  a  strong  function  of  the  Input  exposure  (shown  as 
surface  charge  density)  In  certain  regions  of  operation  of  the  device. 

With  this  output  characteristic,  the  device  Is  operated  with  a  bias  sur¬ 
face  charge  density  which  biases  it  at  the  point  A  In  the  operating  region 
when  the  exposure  level  Is  zero.  Note  also  that  the  device  functions  like  a 
negative  transparency,  and  that  an  upper  limit  must  be  set  on  the  exposure 
level  to  avoid  roll  over.  That  Is,  the  device  must  be  operated  between  the 
points  A  and  E  In  Fig.  12. 

To  determine  the  gamma  of  the  device,  a  plot  of  log  1/T  vs.  log  E  (where 
T  Is  the  output  Intensity  transmittance  for  a  given  exposure  E)  can  be  derived 
from  Fig.  12.  The  slope  of  this  curve  will  be  gamma,  7.  That  Is, 

7  -  log(Ti/T2)/log(E2/Ei)  (17) 

To  first  order,  the  Incremental  surface  charge  density  a(E)  deposited  on 
the  crystal  is  proportional  to  the  exposure  E. 


a(E)  -  (g^)E  (18) 

where  i)  Is  the  quantum  efficiency  of  the  photocathode,  e  Is  the  electronic 
charge,  G  Is  the  gain  of  the  MCP,  h  Is  Planck's  constant  and  v  the  frequency 
of  the  write  light.  Additionally,  the  Induced  phase  change  Ad  In  the  crystal 
Is  proportional  to  o(E)  for  Pockel's  effect  crystals.  The  exact  expression 
depends  on  the  type  and  cut  of  the  crystal  employed. 
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Figure  12.  Readout  intensity  characteristic  of  a  high-gamma  Fabry-Perot 


For  a  Fabry- Perot  etalon  with  surfaces  of  reflectivity  R,  the  ratio  of 
the  total  reflected  intensity  to  the  incident  intensity  (transmittance  T  in 
HSLM  terms)  is  given  by 


Ir/Ii  -  T 


4Rsin^(^) 

(l-R)^+4Rsin^(^) 


(19) 


Thus  the  transmittance  of  the  MSLM  approaches  zero  when  ^  takes  on  mul¬ 
tiple  values  of  2ir.  Equations  (17)  through  (19)  can  be  solved  to  yield  an  ap¬ 
proximate  theoretical  value  for  gamma  within  the  operation  region. 


Further  details  of  the  MSLM  work  is  described  in  a  technical  report  en¬ 
titled,  "Bistable  Configurations  of  the  MSLM”  and  a  Master's  thesis  by  S.  Lau 
submitted  to  JPL  by  Professor  C.  Varde  of  the  Massachusetts  Institute  of  Tech¬ 
nology  (MIT) .  The  report  and  the  thesis  are  attached  as  Appendix  A  and  Appen¬ 
dix  B,  respectively. 


3-2  The  Hushes  and  Loral  LCLV 


A  commercially  available  liquid  crystal  SLM  is  the  Hughes  LCLV.  The 
Hughes  LCLV  has  been  found  useful  in  many  optical  processing  applications 
since  its  Introduction  in  1970.  Another  LCLV  SLM  that  was  introduced,  also  in 
the  1970' s,  is  the  Loral  EOS  device.  The  latter  was  still  under  development. 
We  have  measured  both  the  Hughes  and  the  Loral  LCLV's  for  the  purpose  of  com¬ 
parison.  Ve  have  found  that  the  two  devices  are  sensitive  to  different 
regions  of  the  emission  spectra.  The  Hughes  LCLV  is  more  toward  514.5  nm  and 
the  Loral  is  centered  in  the  red  region.  The  reflectivity  of  the  Hughes 
device  is  a  little  higher  and  so  is  the  writing  sensitivity.  The  operating 
frequency  and  operating  bias  of  the  Loral  LCLV  is  lower  than  the  Hughes  LCLV. 
However,  Loral's  LCLV  does  not  have  a  light  blocking  layer  which  may  be  a 
problem  for  some  applications.  The  details  of  the  experimental  results  are 
included  in  Appendix  C. 


Recently,  we  have  found  that  by  lowering  the  operating  frequency  of  the 
Hughes  LCLV  to  a  value  less  than  1  kHz  from  the  manufacturer's  suggested  10 
kHz,  and  lowering  the  bias  voltage  to  around  7  volts,  a  higher  contrast 
(higher  gamma)  of  the  device's  operation  can  be  obtained.  The  measured  output 
in  terms  of  rotation  angle  versus  input  writing  intensity  is  shown  in  Fig.  13. 

The  gamma  estimated  under  these  conditions  is  around  1.7  in  comparison 
to  the  0.8  obtained  under  normal  operating  conditions.  A  corresponding 
characteristic  curve  of  the  Hughes  LCLV  under  normal  operating  conditions  is 
shown  in  Fig.  14  for  comparison  purposes. 

Under  these  conditions,  we  observed  edge 'enhancement  of  continuous  tone 
input,  and  the  results  were  presented  at  the  OSA  SLM  Topical  Meeting  in  a 
paper  entitled,  "Real-time  Optical  Edge  Enhancement  Using  a  Hughes  Liquid 
Crystal  Light  Valve"  .  This  paper  and  a  collection  of  publications  related 
to  this  contract  is  included  in  Appendix  D. 

3-3  The  Liquid  Crystal  Television  (LCTV)  SLM 

One  exciting  recent  discovery  in  the  SLM  area  is  that  the  LCTV  SLM  can 
be  modified  to  serve  as  an  electronically  as  well  as  optically  addressed  SLM. 

The  LCTV  is  inexpensive  and  allows  a  broad  range  of  experimentation  with  the 
possibility  of  scaling  up  to  layered  architectures.  Its  speed  is  around  30  Hz 
which  is  compatible  with  the  existing  computer  addressing  speed.  The  low  con¬ 
trast  and  low  SBP  problems  are  being  investigated  by  the  TV  manufacturers  and 
breakthroughs  may  come  forth  in  the  future. 

Realizing  the  importance  of  the  LCTVs  for  SLM  applications  to  real-time 
optical  processing,  we  have  measured  the  characteristics  of  three  LCTV  SLMs. 

The  pre-prints  and  reprints  of  papers  on  this  work  are  Included  in  Appendix  D. 
These  papers  contain  detailed  descriptions  of  the  LCTV  SLM  and  its  application. 

3-4  Real-time  Optical  Processing  Applications  of  the  MSLM  and  LCLV 

The  application  of  the  hlgh-gamma  MSLM  In  combination  with  a  halftone 
screen  for  non-linear  optical  processing  was  described  In  a  paper  entitled, 
"High-Gamma  Spatial  Light  Modulator  for  Nonlinear  Optical  Processing"^^ 
authored  by  C.  Warde,  H.  Lamela-Rivera,  and  H.  K.  Liu,  and  was  published  in  SPIE 
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BIAS  VOLTAGE  AND  FREQUENCY  READ-OUT  REFLECTANCE 

AT  7  Vrms  AND  IkHz  P  ^  gjl^2  ^ _iL  J 


Figure  13. 


Polerlzetlon  rotation  angle  versus  write  intensity  of  the 
Hughes  LCLV  under  specific  bias  conditions  for  high  contrast 
operation 


Proceeding  613.  This  paper  is  included  in  Appendix  D.  Further  results  are 
included  in  pages  155-166  of  Appendix  B.  It  has  been  concluded  that  the 
halftone  effects  can  be  clearly  seen  from  the  thresholding  of  the  MSLM. 
However,  SBP  of  the  existing  MSLM  is  not  sufficient  to  be  used  for  image- 
half  toning.  The  uniformity  of  the  MSLM  needs  to  be  improved. 

For  this  reason,  we  have  also  tried  to  use  the  Hughes  LCLV  for  the  high 
gamma  operation.  The  set-up  of  using  the  LCLV  is  shown  in  Fig.  15.  Our  ex¬ 
perimental  results  indicate  that  due  to  the  fact  that  gamma  -  1.7  is  still  not 
quite  sufficient,  the  halftone  effects  are  not  apparent.  Two  methods  can  be 
utilized  to  Improve  the  gamma.  One  is  through  a  positive  feedback  as  sug¬ 
gested  by  A.  Sawchuk,  but  the  speed  of  operation  would  be  slow.  Another 
method  is  to  cascade  two  LCLVs  in  series.  This  set-up  is  shown  in  Fig.  16. 
Since  we  have  only  one  LCLV  at  this  moment,  this  method  will  be  tested  in  the 
future  when  two  LCLVs  are  available. 

3-5  Mew  Real-time  Optical  Processing  Approaches 

A  new  idea  that  may  also  be  tried  is  to  use  the  high  gamma  thresholding 
capability  of  a  photorefractive  crystal.  This  is  to  utilize  the  spatial  light 
modulation  capability  of  the  photorefractive  crystal.  Ue  plan  to  try  this 
method  in  a  future  research  project. 

The  utility  of  the  LCTV  25-26  real-time  optical  processing  is 

reported  in  several  papers  that  are  also  included  in  Appendix  D.  Ue  have  used 
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the  LCTV  for  writing  computer -generated  holograms  ,  pseudo-color  encoding 

oo  29-31 

for  image  enhancement^”,  and  associative  retrieval  neural  processing  . 

A  technique  for  real-time  dynamic  range  comparison  using  photorefractive 
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crystals  and  a  review  on  optical  subtraction  techniques  are  also  presented 

in  Appendix  D.  These  works  have  contributed  to  the  advancement  of  real-time 

optical  image  processing. 

IV.  NEU  ARCHITECTURES  FOR  OPTICAL  PROCESSING 

Ue  have  explored  the  applications  of  SLMs  and  real-time  optical  process¬ 
ing  techniques  for  implementing  new  image  processing  architectures.  These  are 
divided  into  two  parts.  The  first  part  is  the  study  of  optical  array  ar- 
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of  the  input  transparency  and  a  halftone 
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chltectures  for  image  processing.  The  second  part  is  Che  adaptive  multisen- 
sory  neural  processing.  We  describe  these  two  parts  briefly  below,  and  refer 
the  interested  reader  to  more  details  as  Included  in  Appendix  E. 

4-1  Optical  Array  Architectures 

In  optical/VLSI  development.  Che  current  emphasis  is  on  the  reduction  of 
overall  interconnection  complexity  and  the  preservation  of  parallel  and 
pipelined  architecture.  There  are  three  types  of  architectures  that  may  in¬ 
corporate  optical  processing.  These  are  (1)  array  architectures  for  edge 
detection  feature  extraction,  and  for  the  median/rank- order  filtering  used  in 
image  enhancement,  (2)  array  architectures  using  artificial  neural  networks 
for  image  restoration  and  pattern  recognition,  and  (3)  array  architectures  for 
Kalman  filtering  for  least  sqtuires  image  restoration/reconstruction.  A 
detailed  report  by  S.  Y.  Rung  on  this  topic  is  included  in  Appendix  E. 

4-2  Adaptive  Multi-senaorv  Optical  Neural  Processing 

The  principle  of  neural  networks  is  inherently  applicable  in  the 
processing  of  multi-sensory  information  originating  from  different  types  of 
sensors  or  sources.  These  data  usually  need  to  be  digested  rapidly  to  form  a 
coded  data  knowledge  base  that  can  be  used  for  subsequent  fast  analysis  of  new 
"situations"  being  monitored  by  the  saae  set  of  sensors  or  information  gather¬ 
ing  sources.  An  example  of  multi -sensory,  multi -dimensional  processing  is 
signal  processing  based  on  weather  conditions  analysis.  A  multi-channel  phase 
(or  vectorial)  space  concept  of  the  weather  condition  can  be  represented  by  a 
single  phasor  in  the  phase  space  that  contains  components  of  humidity,  tem¬ 
perature,  and  pressure,  etc.  The  phaser  moves  within  the  phase  space  as  the 
weather  conditions  varies.  The  multi-channel  data  can  be  partitioned  into  dif¬ 
ferent  subgroups  of  an  N-dimensional  neuron  vector,  where  N  is  the  total  num¬ 
ber  of  neurons,  each  of  which  can  be  "1"  or  "0”  in  unipolar  binary  number  rep¬ 
resentation.  Multi-channel  spectrogram  and  sonagram  are  also  problems  that 
can  be  dealt  with  by  neural  networks. 

Neural  net  models  offer  a  powerful  methodology  to  information  processing 
that  is  iterative,  distributive,  and  nonlinear.  One  feature  of  biological 
neural  nets  (BNNS)  is  the  maintenance  and  enhancement  of  the  survivability  of 
a  living  organism  in  a  ftizzy  world  where  sensory  impressions  are  sketchy.  Ar¬ 
tificial  neural  nets  (ANNS)  enhance  survivability  through  fault- tolerance. 
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robustness,  speed,  and  adaptability.  Survivability  implies  adaptability 
through  self  organization,  learning,  and  fast  and  accurate  decision  making. 
All  of  these  concepts  are  found  extremely  Important  in  sociology,  economics, 
and  military  science  for  national  defense.  Neuromorphic  computing  will  make  a 
significant  impact  on  future  technolo^  of  collecting,  aggregating,  process¬ 
ing,  and  evaluating  information  for  industrial  and  DOD  applications. 

In  the  implementation  of  a  multi-channel  neural  processing  network,  we 
must  address  two  basic  issues,  namely  massive  interconnectivity  and  artificial 
plasticity  for  self -programming.  The  massive  parallelism  and  free-space 
photonic  interconnection  capabilities  of  optics  should  be  utilized  to  resolve 
these  basic  problems.  For  this  reason  and  as  a  natural  extension  of  the  cur¬ 
rent  research  topic,  we  have  devoted  some  effort  to  the  development  of  a  new 
idea  in  optical  neural  processing.  Ue  have  proposed  the  investigation  of 
multi-sensory  neural  processing  the  investigations  of  the  optical  implementa¬ 
tions  of  the  basic  structure  of  adaptive  linear  neurons  (AOLIME)  for  linear 
and  nonlinear  separability  as  originally  suggested  by  B.  Vidrow.  This  basic 
structure  would  provide  learning  capability  in  the  network.  The  basic  optical 
ADALINE  unit  can  be  organized  to  perform  AND,  OR,  and  MAJ  logic  functions. 
The  work  will  then  be  expanded  to  do  training  in  multi-channel  and  multi¬ 
layer  adaptive  neural  processing  units  that  are  essential  for  translation, 
rotation,  scale,  and  perspective  invariant  pattern  recognition.  Details  of 
this  processing  technique  will  be  submitted  to  ARO  as  a  research  proposal. 
The  various  SLMs  investigated  in  this  contract  can  be  used  for  input,  memory, 
and  thresholding  functions  as  proposed  in  the  new  architecture.  The  halftone 
techniques  developed  are  also  useful  for  preprocesing  input  data  for  image 
enhancement  and  data  reduction  for  ne\u:al  processing. 

V.  CONCLUSION 

The  research  on  real-time  optical  image  processing  was  originally  in¬ 
spired  by  the  idea  of  using  a  specifically  designed  spatial  pulse -width  and 
pulse  frequency  modulation  halftone  screen  and  a  hi^-gamma  micro-channel  spa¬ 
tial  li^t  modulator  for  the  analysis  of  an  input  image  in  terms  of  its  spa¬ 
tial  frequency  content.  This  real-time  operation  can  have  many  image  under- 
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standings  and  Image - enhancement  applications.  The  design  and  analysis  of  the 
pulse • frequency  modulation  was  completed  successfully.  In  the  development  of 
the  high-gamma  MSLM,  it  was  discovered  that  the  resolution,  the  SBP,  and  the 
uniformity  of  the  SIK  still  need  to  be  improved  before  it  can  be  used  for  non¬ 
linear  real-time  image  processing  of  images  of  large  two-dimensional  format. 
Preliminary  experiments,  nevertheless  have  shown  that  real-time  halftone  ef¬ 
fects  are  highly  visible  by  using  this  technique.  This  indicates  the  promise 
of  this  SLM  as  the  SLH  with  high  gamma.  Such  a  high-gamma  SLM  will  also  be 
needed  in  neural  processing  where  SGN  function  thresholding  is  used  in  the 
iteration  process. 

The  LCTV  SLM  and  LCLV  SLM  investigated  in  this  contract  are  helpful  for 
real-time  optical  processing  as  evidenced  by  the  papers  published  by  this 
group  and  others  in  this  country.  When  the  resolution  and  contrast  are  im¬ 
proved  further  by  their  manufacturers,  the  LCTV  SLM's  optical  processing  ap¬ 
plications  will  be  even  more  broadened. 

One  important  result  of  this  research  is  that  it  has  opened  up  pos¬ 
sibilities  for  developing  new  optical  array  processors  and  multi-sensory  adap¬ 
tive  neural  processing  techniques.  Such  new  work  ideas  capitalize  on  the 
unique  strength  of  optics  and  offer  an  opportunity  for  optics  to  make  sig¬ 
nificant  contributions  in  data  processing  for  future  generations  of  special- 
purpose  computers. 
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Bistable  Configurations  of  the  MSLM 


Suzanne  Lau  and  Cardinal  Warde 
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Department  of  Electrical  Engineering  and  Computer  Science 
Cambridge,  Massachusetts  02139 

The  performance  of  two  MSLM  configurations  that  can  be  used  to  achieve 
optically  bistable  operation  are  disctissed.  The  operating  criteria  for  each 
mode  are  investigated  and  the  results  presented. 


1  Introduction 

The  development  of  a  high  resolution  two-dimensional  array  of  bistable  op¬ 
tical  circuits  that  offer  low  switching  threshold  intensity  and  high  framing 
rate  would  be  of  significant  benefit  to  the  fields  of  digital  optical  processing, 
neural  network  processing,  optical  computer  and  VLSI  interconnections,  in 
addition  to  general  purpose  optical  information  processing.  Such  bistable 
operation  could  be  used  to  perform  2-D  logic  operations,  2-D  latches  for 
digital  memory,  level  restoration,  level  amplification,  2-D  analog-to-digital 
conversion,  thresholding,  real-time  Unage  halftoning,  sample  and  hold  op¬ 
erations,  and  2-D  optically  controlled  switches. 

To  overcome  the  accuracy  and  dynamic  range  limitations  of  analog  op¬ 
tical  systems,  digital  optical  systems  have  been  proposed  for  a  wide  variety 
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of  applications  in  numerical  optical  processing.  These  applications  include 
such  areas  as  real  and  complex  number  arithmetic  and  matrix  algebra. 

In  this  paper,  we  describe  two  possible  MicroChannel  Spatial  Light  Mod¬ 
ulator  (MSLM)  [1,2,3]  configurations  which  can  be  used  to  obtain  bistable 
optical  operation:  1)  the  Fabry-Perot  MSLM  and  2)  a  closed-loop  optical 
feedback  configuration. 

2  MicroChannel  Spatial  Light  Modulators 
2.1  Standard  MSLM 

The  standard  MicroChannel  Spatial  Light  Modulator  is  a  versatile,  real¬ 
time  image  processing  device  which  exhibits  high  optical  sensitivity  and  a 
high  framing  speed.  In  its  simplest  form,  it  consists  of  a  photocathode, 
microchannel  plate  (MCP),  a  planar  acceleration  grid  and  an  electro-optic 
crystal  plate  (see  Figure  1).  The  crystal  has  a  high  resistivity  dielectric 
mirror  on  the  side  that  faces  the  grid,  and  a  conducting  electrode  on  the 
other.  The  voltage  sources  Vstcp,  Vtn<i  external  to  the  device. 

In  the  electron-deposition  mode,  the  write  beam  (coherent  or  incoher¬ 
ent  light)  incident  on  the  photocathode  creates  an  electron  image  which 
is  amplified  by  the  MCP  and  proximity  focused  onto  the  dielectric  mirror. 
The  resulting  spatially  varying  electric  field  modulates  the  refractive  index 
of  the  crystal.  Thus,  the  readout  light  which  makes  a  double-pass  through 
the  crystal  is  phase  or  amplitude  modulated,  depending  on  the  crystal  cut 
and  readout  scheme  (polarization  or  interferometric)  employed. 


The  image  is  erased  by  fiooding  the  photocathode  with  light  so  that 
the  electrons  are  removed  from  the  mirror  by  secondary  electron  emission. 
Alternatively,  the  device  can  be  operated  in  the  reverse  mode,  in  which 
the  image  is  written  by  removing  charge  from  the  dielectric  mirror  surface 
by  secondary  electron  emission  and  erased  by  adding  charge  to  the  mirror. 
In  the  linear  operating  mode,  the  incremental  surface  charge  density  (j{E) 
deposited  on  the  crystal  is  proportional  to  the  exposure  E  such  that, 

.(£)=(^)£  (1) 

where  t}  is  the  photocathode  quantum  efficiency,  e  is  the  electronic  charge, 
G  is  the  MCP  gain,  k  is  Planck’s  constant  and  1/  is  the  frequency  of  the 
write  light. 

The  high  exposure  sensitivity,  high  spatial  resolution,  long  storage  time 
and  cascadable  nature  of  the  MSLM  make  it  an  especially  versatile  spatial 
light  modulator.  Optically-addressed  MSLMs  have  already  been  utilized 
in  adaptive  phase  compensation  [4j,  optical  image  processing  (such  as  con¬ 
trast  reversal,  addition,  subraction,  thresholding,  edge  enhancement  and 
logic  operations)  [ij.  More  recently,  an  electron-beam  addressed  (e-beam) 
MSLM  has  been  developed  and  used  in  matrix  multiplication,  with  current 
reseairch  focused  on  implementing  an  optical  inference  machine  for  symbolic 
processing  [5].  In  the  e-beam  MSLM,  the  photocathode  and  the  input  light 
source  are  replaced  by  an  electron  gun  whose  beam  is  focused  directly  onto 
the  the  MCP  input  face;  images  are  written  by  controlling  the  electron 
beam  using  deflection  grids. 

The  electro-optic  crystal  plate  is  the  most  important  component  de- 


tennining  the  MSLM  performance.  The  mechanism  for  modulating  the 
readout  light  is  the  linear  electro-optic  effect  induced  by  an  electric  field 
between  the  spatially-varying  charge  density  on  the  dielectric  mirror  and 
the  transparent  conducting  electrode.  For  Pockeis  effect  crystals,  the  in¬ 
duced  phase  change  crystal  is  proportional  to  the  surface 

charge  density,  c{E)  (where  x'  and  y*  are  the  induced  crystal  axes).  The 
exact  expression  depends  on  the  type  and  cut  of  the  crystal  employed.  For 
example,  in  oblique-cut  LiNbOs  (2]  the  electrically-induced  phase  retarda¬ 
tion  F  Is  of  the  form, 

r(£)  =  i,.  =  (nJv  -  njv)  (2) 

where  A  is  the  wavelength  of  the  readout  light,  C  is  the  average  capacitance 
per  unit  area  of  the  crystal,  n«  and  n«  are  the  ordinary  and  extraordinary 
refractive  indices  respectively,  and  and  are  effective  electro-optic  co¬ 
efficients.  The  amount  of  charge  density  o{E),  or  equivalently  the  voltage 
across  the  crystal,  uniquely  determines  the  amount  of  phase  modu¬ 
lation.  When  such  a  crystal  is  read  out  between  crossed  polarizers,  the 
transmittance  of  the  crystal  is  given  by. 


where  the  phase  retardation  F  is  a  function  of  input  exposure  E. 

2.2  Fabry-Perot  MSLM 

The  Fabry-Perot  version  of  the  MSLM  (F-P  MSLM)  [6]  employs  a  crystal 
that  functions  as  an  clectro-optically  tunable,  Fabry-Perot  etalon  when 
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electrons  are  deposited  or  removed  from  its  surface.  To  fabricate  such  a 
crystal,  standard  dielectric  mirrors  are  deposited  on  both  surfaces  of  the 
crystal  and  then  a  transparent  conducting  overcoat  is  deposited  on  the 


readout  surface  of  the  crystal. 

For  a  z-cut  LiNbOj  device  operated  in  the  reflex  mode,  the  phase  retar¬ 
dation  r  which  results  from  the  electrically  induced  refractive  index  change 
An,  is,  to  a  good  approximation,  proportional  to  the  surface  charge  density 
a{E)  and  to  the  modulator  write  light  exposure  E.  For  this  crystal  cut,  F 
is  given  by 


2irn?riso(r) 

r(E)=4>,  =  ^y  =  — 


(4) 


where  and  are  the  phase  changes  along  the  respective  crystal  axes, 
A  is  the  wavelength  of  the  readout  light  and  V,  is  the  voltage  across  the 

crystal. 

For  a  Fabry-Perot  etalon  with  surfaces  of  reflectivity  R,  it  is  well  known 
that  the  ratio  T,  of  the  total  reflected  intensity  to  the  incident  intensity,  is 

given  by, 

(5) 


r  =  4  = 


4R  sin*  (I) 


/.  (l-/E)*-l-4i2sin*(f) 

This  equation  can  be  rewritten  as, 

Fsin*(f) 
li  l  +  fsin’d) 


(6) 


where  the  coefficient  of  finesse  F  is  defined  as, 


F 


4R 

(1  -  Ry 


(7) 
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Figure  2  is  »  plot  of  T  vs.  the  voltage  across  the  crystal,  V,,  corre¬ 
sponding  to  the  charge  density  o(JF},  uniquely  determines  the  phase  mod¬ 
ulation  (see  Equation  4).  Note  that  the  reflected  readout  transmission  of 
the  F-P  MSLM  approaches  zero  when  ^  takes  on  integer  multiples  of  2t  ra¬ 
dians.  The  halfwave  voltage  V,  is  defined  as  the  voltage  required  for  phase 
modulation  of  r  radians.  For  s-cut  LiNbOs  the  calculated  V,  is  SIOOV 
in  reflection.  An  important  measure  of  the  sharpness  of  the  Fabry-Perot 
fringes  is  the  finesse  /,  which  is  defined  as  the  ratio  of  the  separation  of 
adjacent  maxima  to  the  full  width  at  half  maximum  [FWHM)  and  is  given 
by, 

^  2  “  (1  -  i?) 

Thus,  a  Fabry-Perot  MSLM  with  high  /  will  have  rapid  rise  in  intensity 
on  either  side  of  a  zero.  The  f  can  be  expressed  in  terms  of  V,  or  the 
induced  pathlength  A  through  the  etalon,  s  A), 


FWHM{ii>)  “  FWHM[V,)  fW^M(A)  ^  ^ 

where  A  is  the  wavelength  of  the  readout  light  and  FWHMiJ)  is  the  full 
width  at  half  maximum  expressed  in  terms  of  V,,  or  A  (see  Figure  2). 

The  reflectivity  R  of  the  dielectric  mirrors  deposited  on  the  crystal  sur¬ 
faces  and  the  plane-parallelism  of  the  crystal  surfaces  are  the  determining 
factors  of  the  F-P  MSLM  performance.  R  determines  the  finesse  J  of  the 
etalon  (Equation  8).  By  definition,  the  higher  the  7,  the  narrower  the 
FWHM  and  the  more  sensitive  the  etalon  becomes  to  deviations  of  the 
crystal  surfaces  from  plane-parallelism. 
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3  F-P  MSLM  Image  Processing  Criteria 


We  fabricated  a  F>P  MSLM  that  had  a  crystal  coated  with  mirrors  of 
R  =  0.7.  This  corresponds  to  a  finesse  7  =£  8.76.  The  crystal  had  a  single 
Haidinger  fringe  around  its  25mm  perimeter  before  device  assembly;  this 
corresponds  to  crystal  surface  plane-parallelism  of  about  cs  ±A/4.  No  2-D 
imaging  was  attempted  using  this  experimental  system,  since  the  crystal 
did  not  have  a  large  enough  area  of  uniform  modulation. 

The  physical  limitation  on  the  finesse  /  of  a  F-P  MSLM  that  would  be 
useful  in  image  processing,  is  determined  by  the  deviation  of  the  polished 
electro-optic  crystal  plate  surfaces  from  plane-parallelism.  By  definition, 
the  FWHM{A),  expressed  in  terms  of  optical  pathlength  in  the  etalon,  is 
a  measure  of  the  tolerance  of  the  etalon  to  deviations  from  plane-parallelism 
of  the  crystal  faces.  That  is,  a  region  of  the  crystal  with  thickness  and 
all  other  areas  of  the  crystal  with  thickness  1,  will  modulate  together  if  I 
satisfies  the  following. 


_  FWHMW  <  ,  <  ^  FWBM[A) 

2  2 


This  can  b€  rewritten, 


2 


(10) 


(11) 


Let  us  define  a  measure  of  the  crystal  plane-parallelism  a  as, 

a  =  l/-r.l  (12) 

where  I,  is  the  average  crystal  thickness,  and  /  is  the  crystal  thickness 
at  any  point  of  the  crystal.  To  attain  uniform  modulation  of  the  Fabry- 
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Perot,  the  following  condition  (derived  from  Equation  11)  must  be  satisfied 
throughout  the  modulating  region, 


That  is, 


2  ~  2T 


2a 


(13) 


(14) 


The  result  of  violating  this  condition  was  aptly  demonstrated  by  the  pro¬ 
totype  F-P  MSLM  built,  where  a  s:  A/4  and  I  s:  8.76.  Sustituting  into 
Equation  14, 


(15) 


Alternatively  stated,  T  =  8.76  {R  =  0.7)  would  require  a  crystal  with 
a  <  A/17.S.  Thus,  the  performance  of  high  J  F-P  MSLMs  will  be  severely 
limited  by  the  maximum  achievable  plane-parallelism  of  the  polished  crystal 
surfaces  by  present  technology.  With  the  present  technology  capable  of 
achieving  a  maximum  a  s:  A/4,  J  is  restricted  to  7  <  2  (corresponding  to 
R  <  0.25).  These  limitations  are  not  easily  overcome  using  state-of-the-art 
polishing  techniques,  especially  for  the  thin  crystals  required. 

A  possible  alternative  would  be  the  use  of  a  thin  film  modulator  material 
deposited  onto  an  optically  flat  glass  substrate.  This  would  simultaneously 
ensure  the  plane-parallelism  of  the  modulator  and  improve  the  spatial  res¬ 
olution  of  the  modulator. 

A  method  for  circumventing  the  plane-parallelism  requirement  (and  en¬ 
able  use  of  the  presently  available  crystals),  has  been  suggested  for  use 
with  visible-photocathode  F-P  MSLMs  [3].  In  this  case,  the  crystal  par- 
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allelism  deviations  are  initially  compensated  with  the  appropriate  charge 
distribution  before  any  image  processing  is  done.  This  is  accomplished  by 
an  optical  feedback  configuration  where  the  reflection  of  a  uniform  readout 
light  is  fed  back  to  the  photocathode  until  the  internal  device  nonunifor¬ 
mities  are  compensated  and  a  stable  equilibrium  has  been  attained.  This 
method  is  discrissed  at  length  below. 

4  Optical  Feedback  Configuration 

The  optical  feedback  configuration  of  Figure  3  ia  a  means  for:  (1)  com¬ 
pensating  phase  variations  introduced  by  the  modulator  crystal,  aind  (2) 
realizing  bistable  operation.  Phase  compensation  is  especially  important 
for  high  finesse  Fabry-Perot  MSLMs  which  would  otherwise  require  crystals 
with  extreme  plane-parallelism  unattainable  by  present  polishing  technol¬ 
ogy. 

In  Figure  3,  the  system  or  input  object  under  investigation  is  placed  in 
the  input  plane  (at  Pi)  or  in  the  feedback  path  (at  Pi).  A  variable  spatially' 
uniform  amplitude  attenuation  plate  is  also  placed  in  the  feedback  path  at 
Pj  to  control  the  feedback  level.  The  output  is  recorded  in  plane  Pj.  Note 
that  in  this  case  the  intensity  of  the  signal  fed  back  is  proportional  to  the 
intensity  of  the  output  signal  beam. 

The  crossed  polarizers  in  Figure  3  are  omitted  for  z-cut  crystals  since 
these  are  read  out  interferometrically.  The  MSLM  may  be  operated  in  the 
closed  loop  (feedback)  mode  by  opening  the  shutter  S,  and  in  the  open 
loop  mode  by  closing  the  shutter.  The  MSLM  output  is  monitored  in  the 
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plane  P3  and  is  equal  to  some  fraction  of  the  feedback  signal.  A  procedure 
for  operating  both  a  standard  or  Fabry-Perot  MSLM  in  this  configuration 
would  be  1)  compensate,  closed  loop  2)  bias  crystal,  open  loop  3}  write 
nonlinear  image,  closed  loop.  Phase  compensation  and  bistable  operation 
are  accomplished  as  follows.  The  input  object  is  removed  (uniform  input), 
the  feedback  path  is  closed  (5  open)  and  the  device  is  operated,  preferably 
in  the  electron  deposition  mode,  until  the  readout  intensity  in  plane  P3  is 
uniformly  zero. 

In  this  closed  loop  operation,  areas  of  non-zero  transmittance  of  the 
crystal  will  result  in  feedback  to  the  photocathode  and  deposition  of  sur¬ 
face  charge  on  the  corresponding  areas  of  the  crystal  so  as  to  drive  the 
transmittance  of  the  modulator  at  that  region  to  zero.  The  intrinsic  phase 
variations  of  the  MSLM  are  thus  compensated  with  the  appropriate  amount 
of  surface  charge  and  a  stable  equilibrium  is  attained. 

The  device  should  now  be  biased  to  a  bright  backgroxind  by  operation 
in  the  open  loop  mode  (5  closed)  flooding  the  photocathode  with  light 
and  adjusting  V*  to  add  or  remove  a  uniform  charge  density  while  still 
maintaining  the  phase  compensation  charge  profile.  The  flood  light  is  then 
shut  off  and  set  to  a  large  enough  voltage  such  that  the  gap  voltage 
Vf  remains  high  enough  to  ensure  linear  operation  throughout  the  imaging 
process. 

The  image  transparency  to  be  processed  is  then  placed  in  then  input 
plane  Pi  and  transferred  by  lens  Lq  onto  the  crystal  with  the  shutter  5  open. 
The  resulting  feedback  signal  is  once  again  reimaged  via  the  feedback  path 
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onto  the  photocathode.  In  this  case,  for  a  given  fixed  incident  intensity 
on  the  input  image,  the  high  transmittance  regions  of  the  input  image  will 
at  first  result  in  strong  feedback  and  rapid  deposition  of  sufficient  surface 
charge  on  the  crystal  so  as  to  drive  the  modulator  transmittance  of  those 
points  to  zero  (stable  equilibrium)  within  the  allowed  feedback  time 
On  the  other  hand,  low  transmittance  regions  of  the  input  image  result  in 
weak  feedback,  which  will  in  txim  result  in  very  small  amounts  of  additional 
charge  deposition  on  the  crystal;  thus,  at  the  end  of  the  feedback  time  t„, 
the  transmittance  of  the  modulator  remains  high.  The  MSLM  stores  these 
charge  patterns  and  when  read  out  in  open  loop  mode  using  a  uniform 
source,  a  bistable  image  of  the  input  transparency  results. 

The  theory  describing  the  MSLM  operation  in  this  optical  feedback 
configuration  can  best  be  modelled  by  considering  the  behaviour  of  a  single 
pixel  of  the  modulator  and  neglecting  any  transverse  effects  from  neighbor¬ 
ing  pixels. 

The  intensity  of  the  feedback  signal,  If{t)  can  be  written  as, 


/,(f)  =  /,r(f) 


(16) 


where  is  the  incident  input  intensity  transferred  to  the  crystal,  r(t)  is 
the  particular  time-dependent  transmittance  and  t  is  the  elapsed  feedback 
time,  /•(t),  the  output  signal  is  some  fraction  of  the  feedback  signal  (see 
Figure  4).  For  a  standard  oblique-cut  MSLM  readout  between  crossed 
polarizers,  the  transmittance  r(t)  (from  Equations  2  and  3)  is  given  by, 


T{t)  =  sin*  =  sin* 


(17) 
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where  ^(t]  is  the  total  accumulated  surface  charge  density  on  the  crystal  at 
time  t.  In  the  linear  mode  of  operation  the  incremental  charge  accumulated 
in  the  time  dt  is  derived  from  Equation  1  and  is  given  by 

=  (^) //(O  ■'<  (18) 

The  total  charge  density  integrated  on  the  surface  of  the  crystal  at  time  t 
is  therefore, 

+ ■'o  (19) 

where  oq  is  the  initial  charge  on  the  crystal.  Equation  16  can  now  be 
rewritten  as, 

If(t)  =  4sin»  £  Ij(f)  +  ^  (20) 

where  ^  is  the  phase  retardation  due  to  Oo  and  B  is  a  lumped  MSLM 
constant.  For  the  purpoees  of  this  analysis,  the  lumped  constant  B,  which 
acts  simply  as  a  scaling  parameter,  is  assumed  to  be  equal  to  1.  The  initial 
conditions  at  t  =  0  is, 

/,(<=0)  =  A5m’(^j  (21) 

which  is  the  reflection  doe  to  the  initial  bias  of  the  crystal.  Notice  that  at 
time  tf, 

/,(*,)  =  /<sin»|j^‘' 7/(0 ‘tt’  +  y  =0  (22) 

if 

f  *  //(*')  <ft'  +  ~  =  pir ;  where  p  =  0,  ±1,  ±2, . . .  (23) 

yo  z 

and  moreover, 

0</J' //((') ST  (24) 
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Once  the  feedback  signal  I/{t)  is  driven  to  zero  at  time  t/,  no  further  charge 
deposition  occurs,  so  that, 


lf{t)  =  Ofor  allt  >  t/ 


(25) 


and  stable  equilibrium  is  achieved.  Notice  that  for  phase  compensation, 
the  shutter  5  must  remain  open  long  enough  to  allow  the  entire  crystal  to 
achieve  equilibrium.  This  behavior  is  monitored  in  the  output  plane. 

Alternatively,  for  nonlinear  processing  (e.g.  bistable  operation)  feedback 
is  allowed  only  long  enough  for  areas  of  the  input  with  transmittance  above 
some  threshold  to  be  driven  to  equilibrium.  The  threshold  transmittance 
is  determined  by  the  feedback  time  In  the  ronlinear  processing  case, 
is  such  that, 


for  high  input  transmittance 
for  low  input  transmittance 


Thus  the  modulator  transmittance  will  be  given  by. 


for  high  input  transmittance 
for  low  input  transmittance 


(26) 


(27) 


and  the  desired  bistable  image  will  be  attained  upon  readout  in  the  open 
loop  configuration  with  a  uniform  source. 

The  dynamic  behaviour  of  the  feedback  signal  is  best  analysed  by  nu¬ 
merically  calculating  and  plotting  //(t).  From  the  fundamental  theorem  of 
calculus.  Equation  20  can  be  estimated  as  follows. 


//(t  =  iVAO  =  /iSin* 


lA»l  ^ 


(28) 
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where  the  feedback  signal  is  considered  constant  during  the  incremental 
time  interval  At  =  t/N  ;  N  ts  the  number  of  time  intervals.  The  initial 
condition  is  still  given  by  Equation  21. 

Equation  28  can  be  analysed  for  two  cases:  (1)  varying  the  initial  bias 
phase  ^  due  to  the  crystal  nonuniforznities,  and  (2)  varying  the  input 
intensity  A  transmitted  by  the  input  transparency. 

Figure  5a  contains  plots  of  //(t)  for  multiple  values  of  the  initial  phase 
with  constant  input  intensity  /«.  The  transmission  will  decay  to  zero  faster 
than  the  characteristic  sine-squared  curve  and  equilibrate.  Notice  that  in 
cases  where  ^/2  occurs  before  a  maximum  of  modulator  transmission,  the 
feedback  signal  will  actually  increase  first  before  decaying  to  zero. 

The  effect  of  different  input  intensities  for  the  same  initial  phase  =  ’t 
on  I/{t)  is  shown  in  Figure  5b,  and  the  effect  on  the  modulator  transmit¬ 
tance  T{t)  is  shown  in  Figure  5c.  In  this  case,  ^  is  set  at  ir  radians  and 
the  relative  values  of  the  input  intensities  varied.  Notice  that  I/{t)  (and 
thus,  T(t))  decays  to  zero  more  rapidly  for  higher  input  intensity.  This 
supports  the  discussion  on  the  use  of  this  feedback  configuration  for  non¬ 
linear  applications.  At  some  time  indicated  in  Figure  5c  regions  with 
high  A  are  driven  to  zero  transmittance,  while  those  with  low  A  leading  to 
very  little  additional  charge  deposition,  maintain  relatively  high  modulator 
transmittance. 

A  similar  analysis  has  been  done  for  the  dynamic  behaviour  of  the  Fabry- 
Perot  MSLM.  For  this  version  of  the  device,  the  transmittance  T{t}  is 


derived  from  Equations  5  and  16  rewritten  as 


j  ^  ^  4iZsm»[B>Jo^J,(Odt*-f^l 
^  ’  (1  -  JZ)*  +  4J2sin*  [b> /o'  //(«')  d<'  +  ^ 


(29) 


where  ^  is  again  the  initial  bias  phase  and  S'  is  a  lumped  device  constant. 
Once  again,  is  a  scaling  parameter  and  is  assumed  equal  to  1.  The  initial 
condition  is, 


m  = 


/<4Bsin*  (^) 


(30) 


(l-iZ)»  +  4iZsin*  (^). 

The  feedback  signal  will  again  equilibrate  at  zero  when  t  >  tf,  where  t/ 
is  still  as  defined  in  Equation  23.  The  Fabry>Perot  device  will  operate  in 
much  the  same  manner  as  the  standard  device. 

The  high  finesse  Fabry*Perot  device  will  compensate  for  crystal  de¬ 
viations  from  plane-paralleism  if  sufficient  feedback  time  is  allowed,  and 
can  achieve  nonlinear  operation  when  the  feedback  time  Is  appropriately 
limited.  Equation  29  was  analysed  numerically  and  plots  were  made  for: 
1)  I/{t)  with  constant  /,,  and  different  ^  (shown  in  Figure  6a),  and  2)  //(t) 
and  the  corresponding  T(t)  with  constant  ^  —  k  and  different  relative  J, 
(shown  in  Figure  fib  and  c). 

Notice  that  the  intrinsic  nonlinear  characteristics  of  a  high  finesse  Fabry- 
Perot  crystal  {R  —  0.7)  result  in  similar  nonlinear  behaviour  of  the  feed¬ 
back  signal  and  the  modulator  transmittance.  In  nonlinear  operation,  the 
threshold  input  transmittance  can  be  precisely  determined  by 

The  disadvantage  of  using  this  type  of  feedback  configuration  to  com¬ 
pensate  for  crystal  deviations  from  plane-parallelism  by  charge  deposition, 
is  that  there  is  a  trade-off  in  dynamic  operating  range.  Experimentally  the 
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safe  dynaxziic  operating  range  of  an  MSLM  device  is  about  AkV ;  this  limita' 
tion  is  imposed  by  arcing  between  components  and  stresses  due  to  high  elec¬ 
trostatic  potentials.  Consider  a  standard  device  with  V,r  =  1250^ ;  if  the 
MSLM  to  be  compensated  has  a  crystal  with  plane-parallelism  factor  (see 
Equation  12),  a  =  A/4,  then  the  crystal  will  require  about  V,ji/2  =  625^ 
equivalent  charge  compensation  in  some  areas.  Thus,  about  15%  of  the 
available  operation  range  is  lost  for  compensation,  leaving  over  ZkV  with 
which  to  work;  this  is  not  unreasonable  for  a  crystal  with  Virjt  =  1250  (full 
modulation  can  be  realised  for  a  grid  voltage  of  1  —  2kV). 

However,  the  compensation  trade-off  is  much  more  severe  in  the  case 
of  the  Fabry-Perot.  Consider  a  device  with  a  s-cut  LiNbOs  crystal,  V,  = 
SIOOV;  once  again  assuming  a  s  A/4,  the  crystal  will  require  V,/2  = 
1550V  equivalent  charge  compensation.  This  is  about  40%  of  the  available 
operating  range,  leaving  only  about  2450V  with  which  to  work.  Although 
this  range  Is  greater  than  the  voltage  required  for  a  light  to  dark  transition 
(600  —  800V ;  R  =  0.7),  if  the  grid  voltage  is  1  —  2JkV,  no  allowance  would  be 
made  for  the  fact  that  the  thickness  of  the  crystal  could  be  close  to  (n+ j)A, 
where  n  is  an  integer  and  A  is  the  wavelength  of  the  readout  light.  Thus, 
the  crystal  would  be  biased  in  the  neighborhood  of  the  central  flat  region 
of  the  Fabry-Perot  characteristic.  This  additional  fraction  of  a  wavelength 
miist  be  accounted  for  experimentally  by  properly  biasing  the  operating 
voltages  and  in  the  worst  case  can  require  as  much  as  V,  =  3100V. 

The  ability  to  compensate  internal  device  phase  variations  is  crilical 
for  imaging  with  a  Fabry-Perot  MSLM  using  currently  available  crystals. 
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However,  the  amount  of  phase  compensation  that  can  be  tolerated  while 
leaving  sufficient  operating  range,  is  limited  by  the  precise  crystal  thickness 
deviation  from  an  integer  multiple  of  A,  and  the  voltage  limitations  imposed 
on  the  device. 


5  Summary 

The  MSLM  can  be  used  to  implement  optical  bistable  circuits  in  either 
its  Fabry- Perot  configuration,  or  in  an  optical  feedback  mode.  The  optical 
feedback  mode  may  also  be  used  to  compensate  plane-parallelism  deviations 
of  the  electro-optic  crystal.  The  threshold  level  is  established  by  the  initial 
bias  before  operation  of  the  MSLM.  The  relative  simplicity  of  these  all- 
optical  architectures  are  particularly  attractive  in  more  sophisticated  digital 
optical  processing  applications. 
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FIGURE  CAPTIONS 


Figure  1:  MicroChannel  Spatial  Light  Modulator 


Figure  2:  Readout  characteristic  for  a  Fabry-Perot  MSLM 


Figure  3:  Optical  feedback  configuration  of  the  MSLM 


Figure  4:  Functional  block  diagram  of  the  closed-loop  configuration 


Figure  5:  Output  intensity  //(I)  of  a  standard  MSLM  in  the  closed-loop 
configuration:  a)  for  constant  input  intensity  /,■  with  initial  phase  as  a 
parameter,  b)  for  constant  initial  phase  ^  =  ir  and  with  input  intensity  /,- 
as  a  parameter,  and  c)  corresponding  modulator  transmission  T(t) 


Figure  6:  Output  intensity  /,(()  of  a  Fabry-Perot  MSLM  in  the  closed-loop 
configuration:  a)  for  constant  write  intensity  with  initial  phase  ^  as  a 
parameter,  b)  for  constant  initial  phase  ^  «  ir  and  with  write  intensity  /< 
as  a  parameter,  and  c)  corresponding  modulator  transmission  T[t) 
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Figure  1:  MicroChannel  Spatial  Light  Modulator 
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Figure  6;  Output  inUni itj  //(t)  of  u  Fubry-Perot  MSLM  in  the  cloeed-loop 
configuration:  a)  for  conitant  write  inteniity  A  with  initial  phase  ^  as  a 
parameter,  b)  for  constant  initial  phase  ^  =  ir  and  with  write  intensity  /< 
as  a  parameter,  and  c)  corresponding  modulator  transmission  r(t) 
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Abstract 

The  lack  of  a  general  purpose,  real-time,  reusable  spatial  light  modulator  has 
long  precluded  full  exploitation  oi  the  inhrnnt  speed  and  parallel  processing  ca¬ 
pability  of  optical  s]ntems.  Such  a  higiHreaolution,  (^tically-addressed,  variable- 
ganuna  device  would  be  applicable  to  both  (low  gamma)  and  nonlinear  (high 

gamma)  optical  processing.  This  thests  ineestigatss  the  following  techniques  that 
are  used  to  manipulate  the  switching  characteristic  of  a  MicroChannel  Spatial 
Light  Modulator  (MSLM):  1)  converting  the  standard  device  to  a  Fabry-Perot 
MSLM,  2)  operation  in  a  clo^-loop  feedback  configuration,  3)  operation  in  the 
electron  depoeition/grid  stabilised  mode,  4}  operation  in  the  real-time  hardclipped 
thresholding  mode.  The  desired  switching  characteristic  described  herein  is  more 
suitable  for  characterising  the  behaviour  of  this  spatial  light  modulator  than  the 
conventional  gamma  defined  for  photographic  film.  A  standard  MSLM  operated 
in  the  real-time  hardclipped  thresholding  mode  is  used  to  demonstrate  the  appli¬ 
cation  of  a  high-gamma  MSLM  in  real-time  halftone  screen  processing.  Device 
improvements  and  recommendations  for  future  work  are  also  included. 
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Chapter  1 
Introduction 

The  lack  of  a  general  purpose,  real-tiott  reusable  spatial  light  modulator  has  long 
precluded  full  exploitation  of  the  inherent  speed  and  parallel  processing  capability 
of  optical  systems.  Such  a  device  is  necessary  as:  1)  an  input  data  plane  proces¬ 
sor,  2)  an  optical  filter/interface  in  the  Fourier  plane  and  3)  a  recording/storage 
material.  Silver  halide  photographic  film,  currently  the  most  commonly  used  op¬ 
tical  processing  component,  possesses  one  major  weakness;  its  wet  development 
process  is  cumbersome  and  more  importantly,  cannot  be  carried  out  in  real  time. 

A  high-resolution,  optically-addressed,  variable-gamma  spatial  light  modulator 
would  be  very  useful  for  general  purpose,  real-time  optical  processing.  This  thesis 
describes  how  the  standard  and  the  Fabry-Perot  MicroChannel  Spatial  Light  Mod¬ 
ulators  (MSLM)  can  be  modified  and  operated  to  achieve  a  wide  range  of  gamma 
analogous  to  that  of  phototgraphic  emulsions.  Such  a  variable-gamma  device  will 
be  applicable  to  both  linear  (low  gamma)  and  nonlinear  (high  gamma)  optical 
processing  [1,2,3,4]. 

The  standard  MicroChannel  Spatial  Light  Modulator  is  a  versatile,  real-time 
image  processing  device  which  exhibits  high  optical  sensitivity  and  a  high  framing 
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Figure  1.1:  MicroChannel  Spatial  Light  Modulator 

speed.  In  its  simplest  form,  it  consists  of  a  photocathode,  microchannel  plate 
(MCP),  a  planar  acceleration  grid  and  an  electro^ptic  ciystal  plate  (see  Fig¬ 
ure  1.1).  The  cr]rstal  has  a  high  resistivity  dielectric  mirror  on  the  side  that  faces 
the  grid,  and  a  conducting  electrode  on  the  other.  The  voltages  V^cp,  and 
Vt  are  external  to  the  device. 

In  the  electron-deporition  mode,  the  write  beam  (coherent  or  incoherent  light) 
incident  on  the  photocathode  creates  an  dectron  image  which  is  amplified  by  the 
MCP  and  proximity  focused  onto  the  dielectric  mirror.  The  resulting  spatially 
varying  electric  field  modulates  the  reactive  index  of  the  crystal.  Thus,  the 
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readout  light  which  makes  a  double-pass  through  the  crystaJ  is  phase  or  amplitude 
modulated,  depending  on  the  crystal  cut  and  readout  scheme  (polarization  or 
interferometric)  employed. 

The  image  is  erased  by  flooding  the  photocathode  with  light  so  that  the  elec¬ 
trons  are  removed  from  the  mirror  by  secondary  electron  emission.  Alternatively, 
the  device  can  be  operated  in  the  reverse  mode,  in  which  the  image  is  written  by 
removing  charge  from  the  dielectric  mirror  surface  by  secondary  electron  emission 
and  erased  by  adding  charge  to  the  mirror. 

The  high  exposure  sensitivity,  high  spatial  resolution,  long  storage  and  cascad- 
able  nature  of  the  MSLM  make  it  an  especially  versatile  spatial  light  modulator. 
Optically-addressed  MSLMs  have  already  been  utilised  in  adaptive  phase  com¬ 
pensation  [5],  optical  image  processing  (such  as  contrast  reversal,  addition,  sub- 
raction,  thresholding,  edge  enhancement  and  logic  operations)  [4].  More  recently, 
an  electron-beam  addressed  (£-beam)  MSLM  has  been  developed  and  used  in 
matrix  multiplication,  with  current  research  focused  on  implementing  an  optical 
inference  machine  for  symbolic  processing  (6].  In  the  E-beam  MSLM,  the  photo¬ 
cathode  and  the  input  light  source  are  replaced  by  an  electron  gun  whose  beam  is 
focused  directly  onto  the  the  MCP  input  face;  images  are  written  by  controlling 
the  electron  beam  using  deflection  grids. 

A  summary  of  the  standard  MSLM  operation  is  included  in  Chapter  %  but  no 
attempt  is  made  to  present  MSLM  theory  in  complete  detail.  For  more  complete 
coverage,  the  reader  is  referred  to  References  [l]-[7]. 

The  main  focus  of  this  thesis  is  to  describe  and  analyse  the  techniques  that  can 
be  used  for  converting  the  periodic  write/readout  intensity  characteristic  of  the 
spatial  light  modulator  to  the  desired  switching  characteristic.  These  techniques 
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include: 

•  converting  the  standard  device  to  a  Fabiy-Perot  MSLM 

•  operation  in  a  closed  loop  feedback  configuration 

•  operation  in  the  electron  deposition/grid  stabilized  mode 

•  operation  in  the  real-time  nonlinear  hard-clipped  thresholding  mode 

The  standard  MSLM  and  the  Fabry-Perot  MSLM  are  presented  in  Chapters  2 
and  3  respectively.  Both  devices  are  characterised;  device  parameters,  operating 
voltages,  experimental  set-ups  and  results  are  given.  In  addition.  Chapter  3  in¬ 
cludes  a  discussion  of  the  criteria  for  image  processing  with  a  Fabry-Perot  MSLM. 
Chapter  4  analyses  the  operation  of  an  MSLM  in  the  optical  feedback  configtira- 
tion  for  achieving  crystal  compensation  and  bistable  operation.  In  Chapter  5,  the 
switching  characteristic  for  the  MSLM  is  defined  and  the  intrinsic  and  variable 
gamma  modes  of  operation  characterised.  Chapter  6  describes  possible  optical  in¬ 
formation  processing  applications  in  general,  and  in  particular,  the  experimental 
results  of  real-time  halftone  screen  processing  using  a  standard  MSLM.  Finally, 
Chapter  7  summarises  the  important  results  of  this  thesis  work  and  includes  rec¬ 
ommendations  for  future  work. 
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Chapter  2 

Standard  MSLM 


Substantial  research  has  been  devoted  to  the  development  and  improvement  of 
the  standard  MSLM.  The  theory  of  MSLM  operation  is  well  understood  and  is 
presented  elsewhere  in  g(reat  detail.  The  following  section  contains  a  qualitative 
sununary  of  the  device  description  and  theory  necessary  for  the  purposes  of  this 
thesis. 


2.1  Device  Description 

As  mentioned  in  the  introdxiction,  the  standard  microchaumel  spatial  light  mod¬ 
ulator  consists  of  a  phototcathode,  microchannel  plate  (MCP),  acceleration  grid 
and  electro-optic  crystal  plate. 

The  choice  of  input  window  material  and  photocathode  determine  the  write 
light  wavelength  response  of  the  MSLM.  At  present,  there  exist  multi-alkali  pho¬ 
tocathodes  for  wavelengths  spanning  llOnm  to  1200nm.  As  discussed  later,  the 
MCP  input  face  can  be  excited  directly  using  UV  light,  but  there  exists  no  pho¬ 
tocathode  that  can  be  used  in  the  infmed  region  above  1200nm. 
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A  theory  of  the  microchannel  plate  can  be  found  in  an  article  by  Wiza  [8]. 
The  MCP  (thickness  about  0.5mm)  is  an  array  of  semiconducting-glass  pores 
(diameter  about  lOum)  oriented  parallel  to  each  other.  Each  channel  can  be 
considered  to  be  a  continuous  dynode  electrode  multiplier  with  a  gain  factor  of 
10^  —  10^.  Parallel  electrical  contact  to  each  channel  is  provided  by  deposition 
of  a  metallic  coating,  usually  nichrome  or  inconel,  on  the  front  and  rear  surfaces 
of  the  MCP,  which  then  serve  as  input  and  output  electrodes  respectively.  The 
MCP  is  spatial  resolution  limited  only  by  the  chaimel  dimensions  amd  spacings. 
Originally  developed  as  an  amplification  element  for  image  intensification  devices, 
MCPs  have  direct  sensitivity  to  charged  particles  (electrons  and  positive  ions)  and 
energetic  photons  (UV,  EUV  and  X-ny  wavelengths).  During  operation,  the 
important  parameters  are  the  MCP  bias  voltage  {Vucr)  uid  the  strip  current.^ 
The  ga'm  of  the  MCP  is  characterised  by  the  bias  voltage;  while  the  response  time 
of  the  MCP’  is  inversely  proportional  to  the  strip  current. 

While  the  presence  of  an  acceleration  grid  is  not  strictly  necessary,  it  greatly 
enhances  the  MSLM  operation.  The  presence  of  an  acceleration  grid  biased  pos¬ 
itively  (Vfrid)  with  respect  to  the  MCP  output  electrode  {V^cpovt)  serves  two 
purposes.  Firstly,  the  grid  accelerates  the  electrons  emitted  from  the  MCP  to¬ 
wards  the  crystal,  so  that  a  larger  fraction  of  the  ejected  electrons  contribute  to 
the  primary  current  density  and  good  proximity  focusing  is  maintained  between 
the  grid  and  crystal.  Secondly,  the  grid  increases  the  energy  of  the  electrons 
ejected  by  the  MCP  by  an  amount  eV^rM-  Thus,  the  electron  removal  process  is 
much  more  efficient  in  a  device  with  a  grid.  Attractive  features  for  an  acceleration 
^currant  throogli  th«  niicrochann«l  pUto 

rapooM  time  ia  proportional  to  tht  ckaaaol  racortry  tiina  (tima  to  raplaniak  charga  after 

firing) 
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grid  are  high  electron  transmittance  (large  open  area),  high  tensile  strength,  low 
elasticity  and  low  secondary  electron  emission  yield.  A  metal  mesh  (copper  or 
nickel)  spotwelded  to  a  support  ring  is  usually  used. 

Dielectric  mirrors  consist  of  alternating  layers  of  high  and  low  refractive  in¬ 
dex  dielectric  materials.  Ideally,  the  dielectric  mirror  should  have  high  damage 
resistance  under  electron  beam  bombardment,  high  reflectivity  at  the  readout 
wavelength  and  low  vapor  pressure. 

The  electro-optic  crystal  plate  is  the  most  important  component  determining 
the  MSLM  performance.  The  mechanism  for  modulating  the  readout  light  making 
a  double-pass  through  the  crystal  is  the  linear  electro-optic  effect  induced  by  an 
electric  fleld  between  the  spatially-varying  charge  density  on  the  dielectric  mirror 
and  the  transparent  conducting  electrode.  For  Pockels  effect  crystal,  the  induced 
phase  change  in  the  crystal  is  proportional  to  the  surface  charge  density, 

o{E)  (where  z'  and  y'  are  the  induced  crystal  axes).  The  exact  expression  depends 
on  the  type  and  cut  of  the  crystal  employed.  For  example,  in  oblique-cut  LiNbOj 
the  electrically-induced  phase  retardation  F  is  of  the  form, 

F  =  -  »»’'■.')  (2-1) 

where  \  is  the  wavelength  of  the  exposing  light,  C  is  the  average  capacitance  per 
unit  area  of  the  crystal,  n,  and  n«  are  the  ordinary  and  extraordinary  refractive 
indices  respectively,  and  r,i  and  are  effective  electro-optic  coefficients.  The 
amount  of  charge  density  a{E),  or  equivalently  the  voltage  across  the  crystal,  V,, 
uniquely  determines  the  amount  of  phase  modulation.  When  such  a  crystal  is 
read  out  between  crossed  polarizers,  the  transmittance  of  the  crystal  is  given  by. 
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where  the  phase  retardation  F  is  a  function  of  input  exposure  E.  The  crystal  volt¬ 
age  that  is  needed  to  produce  a  phase  modulation  of  ir  radians  with  a  double-pass 
through  the  crystal  is  referred  to  as  the  reflection  halfwave  voltage,  corre¬ 
sponding  to  the  reflection  halfwave  surface  charge  density,  OrR.  Devices  to  date 
have  used  s-cut  LiNbOs  for  phase  modulation  and  SS’-cut  LiNbOs  for  intensity 
modulation.  This  55**  crystal  cut  optimises  the  phase  retardation  yielding  a  min¬ 
imum  calculated  V,r  of  1250K.  An  alternative  way  of  expressing  the  modulator 
transmission  in  terms  of  the  crystal  voltage  is. 


2.2  Principles  of  Operation 

The  voltage  across  the  crystal,  V,,  and  the  voltage  across  the  vacuum  gap,  V,,  as 
shown  in  Figure  2.1  are  related  to  the  externally  controlled  voltages,  and  Vgridt 
by: 

V»  =  V,-|-V.  +  V,rtd  (2.4) 

The  effects  of  the  ballast  resistors,  Rfru  &nd  Rk,  are  neglected.  The  gap  is  defined 
as  the  space  between  the  grid  and  the  dielectric  mirror. 

Changes  in  the  externally  applied  voltages,  or  Vgrn,  are  divided  capacitively 
between  the  gap  and  the  crystal.  However,  since  the  crystal  capacitance  is  much 
greater  than  the  gap  capacitance,  the  changes  in  voltage  are  coupled  to  a  large 
extent  across  the  gap.  The  crystal  voltage,  is  therefore  determined  only  by 
the  charge  density  already  present  on  the  surface  of  the  crystal. 

Primary  electrons  are  ejected  from  the  MCP,  accelerated  by  the  grid,  strike 
the  dielectric  mirror  surface  and  generate  secondary  electrons.  For  sufficiently 
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high  primary  electron  energy,  each  primary  electron  generates  more  than  one 
secondary.  These  secondary  electrons  are  then  collected  by  the  mirror,  or  the 
grid,  depending  strongly  on  V,. 

For  high  values  of  V,,  all  the  secondary  electrons  are  attracted  back  to  the 
mirror,  and  charge  accumulates  on  the  mirror  surface  at  some  maximum  rate. 
If  neither  Vi  nor  Vgrid  Me  adjusted,  the  accumulation  of  electrons  will  cause  V, 
to  decrease.  As  V,  falls  below  about  50V,  some  secondary  electrons  will  have 
stif&cient  energy  to  traverse  the  gap  and  be  collected  by  the  grid,  and  the  rate 
of  accumulation  of  charge  on  the  mirror  will  decrease.  This  accumulation  will 
continue  until  the  number  of  primary  electrons  striking  the  mirror  is  equal  to  the 
number  of  secondary  electrons  collected  by  the  grid,  and  Vf  has  reached  some 
equilibrium  value.  This  equilibrium  voltage  is  usually  a  few  volts  positive,  but 
for  all  practical  purposes,  is  assumed  to  be  zero  volts;  therdbre,  the  grid  and  the 
surface  of  the  mirror  are  assumed  to  be  at  the  same  potential  in  equilibrium. 

If  Vg  is  initially  slightly  below  the  equilibrium  gap  voltage,  the  generated  sec¬ 
ondary  electrons  will  be  collected  by  the  grid,  resulting  in  a  net  loss  of  electrons 
from  the  mirror  until  V,  is  once  again  in  equilibrium. 

When  there  exists  a  large  negative  field  across  the  gap,  the  energy  of  the 
primary  electrons  will  be  greatly  reduced.  This  results  in  a  much  greater  number 
of  primary  electrons  striking  the  mirror  than  sscoodaiy  electrons  generated  and 
collected  by  the  grid.  Thus,  there  will  be  an  accumulation  of  electrons  on  the 
mirror  which  will  cause  V,  to  decrease  until  the  repulsive  field  is  so  large  that 
the  primary  electrons  can  no  longer  traverse  the  gap.  The  system  is  now  in 
LOCKOUT:  the  value  of  V,  at  which  this  occurs  is  known  as  the  lockout  voltage 
and  is  the  voltage  below  which  no  primaries  have  sufficient  energy  to  reach  the 
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mirror  and  are  all  collected  by  the  grid.  The  crystal  surface  charge  density  can 
now  only  be  changed  by  manipulating  the  external  voltages,  V,h4  or 

2.3  Linear  Operating  Modes 

In  a  linear  mode  of  operation,  the  incremental  surface  charge  density  o(E)  de¬ 
posited  on  the  crystal  is  proportional  to  the  exposure  E  such  that, 

'(S)  =  (^)  ®  P  ») 

where  t)  is  the  photocathode  quantum  efficiency,  e  is  the  electronic  charge,  G  is 
the  MCP  gain,  h  is  Planck's  constant  and  i/  is  the  frequency  of  the  write  light. 
Therefore,  for  a  Pockels  effect  crystal,  the  induced  phase  retardation  in  the  crystal 
will  also  be  proportional  to  E. 

From  the  discussion  in  the  previous  section,  it  is  now  apparent  that  there  are 
two  such  modes  of  operation:  1)  write  by  electron  deposition  and  2)  write  by 
secondary  electron  emission  (electron  depletion). 

In  the  electron-deposition  mode,  the  gap  voltage  most  be  maintained  at  a  high 
enough  voltage  level  to  ensure  proximity  focusing.  Images  may  then  be  written 
by  exposing  the  photocathode  to  tomt  input  and  integrating  the  charge  on  the 
mirror  for  a  sufficient  length  of  time  to  obtain  a  spatially-varying  F  proportional  to 
(eqns.  2.1  and  2.5).  Tlus  is  accomplished  by  first  biasing  V,r*s  up  to  2kV .  Then, 
the  background  level  is  adjusted  by  setting  to  some  bias  level  (dependent  on 
the  particular  crystal),  and  flooding  the  photocathode  with  light  until  equilibrium 
is  reached  and  there  is  a  uniform  charge  distribution  on  the  mirror.  Next,  is 
set  to  some  write  voltage,  and  the  photocathode  exposed  to  the  input  image 
for  an  appropriate  write  time.  The  write  process  is  terminated  by  turning  off  the 
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write  light.  The  crystal  may  be  erased  by  flooding  the  photocathode  with  light 
and  depositing  a  uniform  charge  distribution  as  before,  then  lowering  V4  to  the 
appropriate  level  with  the  light  still  on. 

The  electron>depletion  mode  requires  more  sophisticated  control  of  V^.  The 
grid  is  once  again  biased  up  to  2ikV  and  the  background  level  is  adjusted  as 
before.  Then,  with  the  write  light  on,  V»  is  ramped  downwards  at  a  preset  rate 
Vi  =  dVi/dt  such  that  no  areas  of  the  mirror  will  be  locked  out.  Electrons  are 
therefore  removed  from  the  crystal  surface  in  amounts  proportional  to  /«,.  Once 
again  the  write  process  is  stopped  by  turning  off  the  write  light  and  stopping 
the  ramp.  This  image  is  erased  by  rusing  the  crystal  voltage  to  some  and 
depositing  a  uniform  amount  of  electrons  on  the  crystal  surface  by  flooding  the 
photocathode  with  light. 


2.4  Experimental  System 

2.4.1  The  Hamamatsu  MSLM 

The  standard  MSLM  used  for  this  thesis  work  was  a  vacuum-sealed  MSLM  fab¬ 
ricated  by  Hamamatsu  Photonics  K.  K.  (Model  X-1699,  MM171)  [9].  The  device 
structure  is  shown  in  Figure  2.2.  The  dimensions  of  this  MSLM  are  52mm  in 
diameter  and  80mm  in  length.  The  device  employs  a  multi-alkali  photocathode 
(type  S-20)  and  an  approximately  50^m  thick,  55* -cut  LiNbOj  crystal.  Electron 
optics,  in  the  form  of  the  accelerating  and  focusing  grids  (71  and  (72,  are  em¬ 
ployed  for  transferring  the  electron  image  onto  the  MCP.  The  output  window  is 
coated  with  an  anti-reflection  coating  on  the  outer  nde,  whilst  the  inner  side  has 
a  transparent  coating  which  is  both  anti-reflecting  and  conducting  (serves  as  the 
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Photocathode  MCP 


Electro-optic  Crystal 

Grid  electrode 


Accelerating  and  focusing  electrodes 

Figure  2.2:  Vecuum-sealed  standard  Hamamatsu  MSLM 

crystal  electrode).  The  crystal  has  a  dielectric  mirror  on  the  MCP  side  and  an 
anti<reflection  coating  on  the  other  side,  and  is  bonded  with  epoxy  to  the  output 
window.  A  material  with  high  secondary  electron  emission  is  evaporated  on  top  of 
the  dielectric  mirror  to  improve  the  MSLM  response  time.  The  effective  diameter 
of  the  crystal  is  about  18mm.  The  baking,  cleaning  and  assembly  procedure  of  this 
device  is  unknown.  The  vapor  pressure  is  assumed  to  be  well  below  1  x  10~^  torr 
when  sealed,  to  enable  operation  of  the  photocathode.  Further  information  about 
the  components  and  the  device  architecture  is  unavailable. 

2.4.2  Power  Requirements 

Typical  operating  voltage  requirements  for  the  Hamamatsu  MSLM  and  the 
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Eleetrode 

Symbol 

Voltage  (kV) 

Supply 

Photocathode 

Vpc 

-3.0 

Bertan  Model  205A-05R 

Focusing  and 

Vox 

-1.5 

MSLM  ControUer  #  2,  Vq 

Acceleration  grids 

Voi 

-2.7 

MSLM  Controller  #  1, 

Anode  (MCPi„) 

-1.0 

Bertan  Model  205A-05R 

MCP^ 

0 

Grounded 

Grid 

+1.0 

Bertan  Model  205A-05R 

Crystal 

V* 

0-3.0 

MSLM  Controller  #  1,  Vi;,V* 

Table  2.1:  Power  requirements  for  Hamamatsu  MSLM  (Strip  current  10/iA) 


high  voltage  power  supplies  actually  used  are  shown  in  Table  2.1.  Three  Bertan 
high  voltage  power  supplies  (Model  205A'(}5R)  were  used  to  bias  the  photocath¬ 
ode,  MCP  and  grid.  The  remaining  power  requirements  were  supplied  by  two 
MSLM  Controllers  (Model  1201/2),  labelled  #  1  and  #  2,  that  were  custom- 
made  by  the  Massachusetts  Manufacturing  Corporation.  Each  controller  has  three 
floating  de  high  voltage,  low  current  supplies.  The  controller  also  has  a  grounded 
crystal  voltage  supply  which  was  designed  speciflcally  for  biasing  the  crystal  elec¬ 
trode  of  an  MSLM.  The  crystal  supply  has  both  de  and  framing  modes.  In  the 
de  mode,  the  supply  output  is  controlled  by  one  of  two  front-panel  controls 
and  V|A,  which  are  used  to  set  write  and  threshold  voltages,  respectively.  This 
mode  allows  operation  of  the  MSLM.  When  operated  in  the  framing  mode, 

the  supply  output  follows  the  waveform  of  Figure  2.3,  either  single  triggered  or 
continuously  cycled.  The  voltage  levels  and  timing  of  indicated  portions  of  the 
waveform  can  be  controlled  independently,  and  parts  or  all  o(  the  waveform  can 
be  generated.  The  controller  also  provides  low  voltage,  AB  (ISV)  logical  outputs 
which  were  used  to  synchronise  write  and  erase  lights  with  different  parts  of  the 
waveform.  The  MSLM  controller  was  able  to  provide  all  of  the  necessary  voltage 
waveforms  required  for  the  work  herrin. 
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In  order  to  protect  the  power  supplies  in  the  event  of  accidental  arcing  between 
MSLM  components,  ballast  resistors  were  placed  in  series  with  the  power  supplies. 
Drainage  resistors  were  placed  in  parallel  with  the  Bertan  supplies  to  accelerate 
the  decay  of  their  large  internal  capacitances.  A  capacitor  was  also  added  to  the 
crystal  electrode  to  eliminate  rapid  high  voltage  transients  which  occur  during 
supply  tum-on  and  turn-off.  The  MCP  input  and  output  currents  were  monitored 
during  operation.  Figure  2.4  shows  the  electronic  biasing  box  that  was  built;  great 
care  was  taken  to  ensure  that  all  high  voltage  connections  were  spaced  far  apart 
and  the  aluminum  box  grounded. 

2.4.3  Optical  System 

The  optical  system  tised  to  write  and  to  readout  information  from  the  Hamamatsu 
MSLM  is  shown  in  Figure  2.5  .  The  crystal  is  read  out  between  crossed  polarizers 
oriented  45*  with  respect  to  the  crystal  axis.  Spatial  filtering  in  the  transform 
plane  removed  any  undesired  refiections.  The  readout  optics  had  a  magnification 
of  about  2.25.  The  output  image  was  monitored  using  a  Panasonic  TV  camera 
(Model  WV  1550)  and  TV  monitor,  tMs  allowed  simultaneous  controlling  of  the 
MSLM  power  and  monitoring  of  the  output  image.  The  write  light  source  was 
a  25  Watt  Soft  Light  incandescent  light  bulb  with  a  red  filter  placed  in  front  to 
disperse  the  light.  The  write  light  was  collimated  as  shown  in  the  write  optics  and 
used  to  illuminate  an  image  transparency  in  the  input  object  plane.  The  input 
transparency  could  be  translated  in  the  x  —  y  transverse  plane  with  about  0.5mm 
accuracy  and  along  the  s-direction  (optic  axis)  with  about  0.1mm  accuracy.  This 
allowed  accurate  positioning  and  focusing  of  the  input  image  on  the  face  of  the 
photocathode;  the  write  imaging  optics  had  unity  magnification.  A  red  LED 
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CrytUl  Grid  MCP««  Anode  G2  Gl  Photocnthode 


Figure  2.4:  Stnndard  MSLM  binsing  box 
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placed  behind  a  dispersive  red  filter,  was  employed  to  flood  the  photocathode  with 
light  during  erasure  and  bianng.  The  write  input  image  was  shuttter  controlled 
while  the  erase  LED  was  powered  on  and  off  as  needed.  The  input  transparencies 
were  fabricated  using  35mm  Polaroid  Polapan  B  &  W  continuous-tone  film  and 
mounted  in  slide  holders.  The  image  of  a  1951  Air  Force  resolution  chart  was 
also  used  as  an  input  pattern.  The  Air  Force  resolution  chart  itself  was  made 
by  Opto-Line  Corporation  and  consisted  of  an  etched  chrome  layer  on  a  quartz 
substrate  (the  transmittance  of  the  opaque  layers  was  leas  than  0.1%  ). 

The  visible  photocathode  was  found  to  be  extremely  sensitive  to  any  stray 
light  in  the  roona.  While  this  sensitivity  is  desirable  in  the  MSLM,  input  images 
written  onto  the  device  were  being  tmeartd  out  by  very  low  background  light  lev¬ 
els.  To  resolve  this  problem,  the  entire  write  path  was  totally  enclosed  and  the 
photocathode  completely  isolated  ^m  any  stray  room  Ught,  readout  laser  scatter¬ 
ing  and  even  write  light  reflections  within  the  write  path.  This  was  accomplished 
quite  simply  using  cardboard  boxes,  baffels,  tubing  and  substantial  amounts  of 
duct  tape. 

2.4.4  Output  Devices 

Output  images  were  photographed  using  Polarmd  type  55PN  fllm  with  the  ex¬ 
posure  time  controlled  by  a  shutter  placed  in  front  of  the  laser.  For  those  cases 
where  the  intensity  in  the  output  plane  was  measured,  a  Hamamatsu  Si  PIN  diode 
biased  in  its  linear  re^on  was  used.  The  voltage  level  proportional  to  the 
output  image  intennty,  /«,  is  equal  to  the  measured  voltage  level,  minus 

the  voltage  due  to  the  detector  dark  level  and  the  ambient  light  level, 

Vsftswk  (2*®) 
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Thus,  before  any  data  is  taken  in  a  given  run,  a  reading  of  Vj,tdark  is  taken.  All  of 
these  voltage  readings  are  taken  after  a  sufficient  settling  time  and  are  assumed 
to  be  time-averaged. 

2.5  Device  Performance 

Since  the  Hamamatsu  MSLM  was  vacuuxxMeaied  and  the  internal  components  of 
the  device  unchangeable,  great  care  was  taken  to  avoid  any  destructive  operating 
regions.  The  maximum  possible  grid  voltage,  Vgrid,  was  found  to  be  2.3kV ;  at  this 
voltage,  the  force  between  the  grid  and  the  MCP  output  face  was  large  enough 
to  stretch  the  grid  and  touch  the  MCP,  resulting  in  arcing  and  damage  of  the 
MSLM  power  supply  being  used  for  the  grid.  The  grid  was  thereafter  set  at 
+1.0^1^  which  allowed  sufficient  proximity  focuring  and  convenient  manipulation 
of  Vt  during  writing.  The  crystal  voltage  V»  was  generally  limited  to  a  range  of 
0  —  3.0kV  during  operation;  voltages  outside  of  this  so/e  range  resulted  in  damage 
to  the  crystal  (see  Appendix  B).  The  MCP  was  biased  at  -l.OkV  with  a  strip 
current  of  about  lOfiA.  The  photocathode  was  biased  at  —3.0kV,  and  the  optimal 
focusing  grid  voltages  were  V^i  =  —\.hkV  and  Vat  =  —2.7kV.  V»  was  controlled 
by  a  floating  supply  to  set  the  bias  level  and  the  MSLM  timing  waveform  to 
produce  the  reqirized  high  voltage  proflles  for  operation. 

A  number  of  iffiosyncraries  were  observed  while  operating  this  device  and  are 
believed  to  be  related  to  some  device  modiflcations  made  <m  the  original  MSLM 
prototypes.  These  are  discussed  at  length  in  Appendix  B.  These  peculiarities 
were  superimposed  on  the  output  images  and  can  be  observed  in  the  photographs 
taken  in  the  output  plane.  While  these  effects  are  aesthetically  unattractive,  they 
are  not  universal  to  MSLMs  and  are  neglected  for  the  purposes  of  this  thesis. 
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Recall  that  the  modulator  has  a  sine-squared  dependence  with  respect  to  the 
voltage  across  the  crystal  V,  for  an  oblique-cut  LiNbOs  crystal  read  out  between 
crossed  polarizers,  such  that, 


where  I,  is  the  input  intensity,  /«  is  the  reflected  readout  intensity  and  is 
the  reflex  halfwave  voltage.  A  plot  of  T  vs.  Vg  is  shown  in  Figure  2.6. 
can  therefore  be  measured  quite  simply  by  monitoring  the  intensity  of  the  output 
image  for  a  series  of  settings  when  a  constant  write  intensity  is  incident  on  the 
photocathode.  After  a  sufficient  settling  time  for  each  setting,  the  gap  voltage 
equilibrates  to  about  OV,  and  the  voltage  change  in  couples  entirely  across  the 
crystal. 

When  this  measurement  was  attempted  on  the  Hamamatsu  MSLM,  the  voltage 
Vj  was  varied  from  -1.0  to  -fS.OlcV’  with  a  of  l.OkV  (that  is,  V,  from  -2.0 
to  +2.0kV).  A  nunimum  in  the  output  intensity  occured  when  sa  0.9  -  l.OfcV, 
depending  on  how  long  the  device  had  been  operating.  However,  no  maxima 
were  observed  and  the  output  intensity  still  increased  at  either  end  of  the  allowed 
voltage  range.  The  range  of  was  not  increased  any  further  for  fear  of  detrimental 
effects  to  the  crystal  (Appendix  B).  The  data  obtained  by  this  measurement 
was  fitted  to  a  sine-squared  curve,  and  the  mean  square  error  minimised  with 
respect  to  Vgn.  This  method  yielded  an  estimate  for  of  about  4.5fcV  for 
the  LiNbOs  crystal  in  the  Hamamatsu  device.  This  does  not  agree  with  the 
predicted  value  of  1250V  for  a  SS’-cut  LiNbOs  crystal.  An  explanation  for  this 
discrepancy  requires  more  information  about  knowledge  about  the  crystal  and 
the  device  construction.  Further  investigation  and  actual  measurement  of  VgR 
would  have  resulted  in  destructive  operation  of  the  device  and  was  therefore  not 
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Figure  2.6:  Readout  Characterietic  for  a  standard  MSLM  with  Pockels  effect 
crystal 
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attempted. 

This  standard  MSLM  was  operated  in  what  is  believed  to  be  the  Oq  to  co  + 
region  of  the  characteristic  modulator  readout  curve  (corresponding  to  Vg  from 
-1.0  to  +2.0kV). 

Two  important  parameters  for  assessing  the  performance  of  an  MSLM  are  the 
framing  rate  and  the  spatial  resolution.  The  cycle  time  of  a  device  is  defined  as 
the  sum  of  the  time  required  to  deposit  a,  charge,  and  the  time  required  to 


remove  a,  charge,  t,„ 


The  framing  rate  1/t,  is  dependent  on  the  input  intensity,  photocathode  efficiency, 
MCP  gain,  MCP  strip  currrent  (high  strip  current  MCP’s  have  fast  recovery 
times),  the  energy  of  the  primary  electrons  through  V,,  the  halfave  charge  density 
<r,r<  the  spacing  between  components  and  device  structure.  No  attempt  was  made 
to  measure  the  maximum  framing  rate  of  this  device  since  it  would  require  V', 
of  Vg  +  Virx  (>  A,5kV),  a  much  higher  voltage  on  the  grid  and  saturation  of  the 
photocathode  (this  tends  to  degrade  the  photocathode  sensitivity).  Typical  erase 
times  ranged  from  1  —  60  seconds  for  erasure  from  D  toC  (Figure  2.6). 

The  spatial  resolution  characterisrics  of  a  device,  or  optical  component  are 
usually  evaluated  in  terms  of  the  Modulation  Transfer  Function  (MTF).  When 
the  input  signal  is  an  image,  as  in  the  MSLM  case,  the  abbreviation  MTFu  is  used 
to  indicate  a  light-to-light  coherent  modulation  transfer  function.  The  normalized 


MTFm  is  defined  as, 


MT/’m  =  ~  r"^"/ 1 


where  Imsmit')  and  InUni*')  ^  the  maximum  and  minimum  intensity  values  at 
spatial  resolution  u  in  the  coherent  readout  beam  and  m  is  the  spatial  modulation 
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index  of  the  input  write  light.  The  MTFu  was  experimentally  determined  by  using 
the  image  of  a  1951  Air  Force  resolution  chart,  and  projecting  it  onto  the  face  of  the 
photocathode  with  the  write  optics.  Great  care  was  taken  to  focus  the  resolution 
chart  using  a  precision  translator  along  the  optic  axis,  and  to  prevent  any  stray 
light  from  reaching  the  photocathode.  The  modulation  index  of  the  input  image, 
m,  was  assumed  to  be  about  unity  for  all  the  input  frequencies  that  were  used. 

The  entire  crystal  was  first  biased  at  C  (this  corresponds  to  the  minimum  mod¬ 
ulator  transmittance)  and  the  image  of  the  resolution  chart  written  by  electron 
deposition  with  an  average  charge  density  of  oo  +  <^r/4*  This  was  accomplished  by 
writing  for  a  time  which  is  the  time  required  to  deposit  enough  charge  on  the 
crystal  to  reach  D  with  a  uniform  write  light  intensity  (sero  spatial  frequency); 
this  must  be  the  same  write  light  that  is  used  to  illuminate  the  resolution  chart. 
Figure  2.7a  is  a  photograph  of  the  modulated  output  image  written  as  above.  The 
negative  from  this  photograph  was  mounted  on  a  glass  plate  and  scanned  using  a 
Jarrel-Ash  #  21-050  hficrophotometer.  After  the  background  transmittance  of  the 
negative/glass  plate  and  the  recording  characteristics  of  the  film  were  taken  into 
account,  the  values  of  and  /«wf»(<^)  obtained  from  the  microphotometer 

were  used  to  calculate  MTFu  using  Equation  2.9.  Care  must  be  taken  to  expose 
the  film  such  that  all  information  is  recorded  in  its  linear  repon.  This  standard 
MSLM  had  a  measured  spatial  resolution  cS  about  4  Ipimm  at  50%  modulation 
according  to  the  above  procedure. 

Figure  2.7b  is  a  photograph  of  the  resolution  chart  written  by  electron  removal. 
In  this  case,  the  crystal  is  first  biased  at  D,  then  with  the  resolution  chart  incident 
on  the  photocathode,  the  voltage  Vt  is  ramped  downward  to  C  at  a  rate  V*;  this 
rate  corresponds  to  the  rate  required  to  have  a  charge  denstiy  Oq  on  the  crystal  at 
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the  end  of  the  ramp  when  a  uniform  write  light  (zero  spatial  frequency)  is  used. 


CHAPTER  2.  STANDARD  MSLM 


36 


Figure  2.7:  Resolution  chert  imege  by:  e)  electron  depoeition,  and  b)  electron 
depletion 
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Fabry-Perot  MSLM 


3.1  Device  Description 


The  Fabry-Perot  version  of  the  MSLM  (F-P  MSLM)  [10]  employs  a  crystal  that 
functions  as  an  electro-optically  tunable,  Fabry-Perot  etalon  when  electrons  are 
deposited  or  removed  horn  its  surface.  To  fabricate  such  a  crystal,  standard  dielec¬ 
tric  mirrors  are  deposited  on  both  surfaces  of  the  crystal  and  then  a  transparent 
conducting  overcoat  is  deposited  on  the  readout  surface  of  the  crystal. 

For  the  s-cut  LiNbOj  device  operated  in  the  reflex  mode,  the  phase  retardation 
r  which  results  from  the  electrically  induced  refractive  index  change  An,  is,  to  a 
good  approximation,  proportional  to  the  surftce  charge  density  <r(£)  and  to  the 
modulator  write  light  exposure  £.  F  is  ^ven  by: 


_  .1  _  .c  _  2xn»rwa(£) 

- - 


(3.1) 


where  and  are  the  phase  changes  along  the  respective  crystal  axes,  A  is  the 
wavelength  of  the  expostire  light  and  V,  is  the  voltage  across  the  crystal. 

For  a  Fabry-Perot  etalon  with  surfaces  of  reflectivity  iZ,  it  is  well  known  that 
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the  ratio  T,  of  the  total  reflected  inteneity  to  the  incident  intensity,  is  given  by. 


It  _  (\) 

h  ~  (1  -  A)*  +  4i?8in*  (f) 


This  equation  can  be  rewritten  as, 

r  /.  (t) 

A  1  +  f  rin*  (f] 

where  the  coefficient  of  flnesse  F  is  deflned  as, 


(1  -  RY 


Figure  3.1  is  a  plot  of  T  vs.  is  ^ven  by  Equations  3.1  and  3.2.  Note  that 
the  reflected  readout  transmission  of  the  F*P  MSLM  approaches  sero  when  ^  takes 
on  integer  multiples  of  2it  raffians.  The  halfwave  voltage  is  once  again  defined 
as  the  voltage  required  for  phase  modulation  of  k  radians.  For  s-cut  LiNbOs  the 


calculated  is. 


V,  =  -4—  =  3100^ 
2f»*rw 


Notice  that  in  Figure  3.1,  for  K,  =  0;  this  would  require  that  the  crystal  be 
poUshed  exactly  to  the  correct  thickness  and  is  unnecessary  since  h  can  be  biased 
to  any  desired  levd  by  deposting  charge  on  the  crystal.  An  important  measure 


of  the  sharpnem  tA  the  Fabry-Perot  Cringes  is  the  finesse  /*,  which  is  defined  as 
the  ratio  of  the  separation  of  adjacent  maxima  to  the  full  width  at  half  maximum 
{FWHhi)  and  is  given  by, 

/  s  s  (3.6) 

Thus,  a  Fabry-Perot  MSLM  with  high  /  will  have  rapid  dropoff  in  intensity  on 
either  side  of  the  sero.  The  J  can  be  expressed  in  terms  of  or  the  induced 


108 


Readout  Tranemittance 


I 

I  CHAPTERS.  FABRY-PEROT  MSLM  39 

1 

I 

i 

i 


Figure  3.1:  Readout  characterietic  for  a  Fabry-Pttot  MSLM 


CHAPTER  3.  FABRY-PEROT  MSLM 


40 


pathlength  through  the  etalon,  A 

r-  -  V  (37) 

FWHM{4>)  FWHMiV,)  FWHM(A)  ' 

where  A  ia  the  wavelength  of  the  readout  light  and  FWHM[‘)  is  the  full  width  at 

half  maximum  expressed  in  terms  of  or  A  (see  Figure  3.1).  Notice  that  the 

voltage  swing  required  for  a  full  light-to^ark  transition  (or  vice  versa)  transition 

V’l  is  approximately  equal  to  FWHM{V,)  and  thus, 

W  4V  V 

=  (3.8) 

Therefore  the  F«P  MSLM  only  requires  a  voltage  swing  of  ^  for  full  !>ght>to-dark 
tranation  as  compared  to  V,g  for  a  standard  device.  If  the  F-P  is  initially  biased 
at  its  xero  point,  this  represents  a  y/F  improvement  over  the  speed  of  standard 
devices. 


3.2  Linear  Operating  Modes 

The  high'fineMC  characteristics  of  the  F-P  MSLM  lead  to  almost  nonlinear  op¬ 
eration  when  operated  in  its  linear  modes;  this  is  particularly  powerful  for  im¬ 
plementing  nonlinear  processing  without  any  additional  filtering.  The  electron 
accumulation  and  the  dectron  deposition  modes  of  the  F-P  device  are  similar  to 
those  discussed  for  a  standard  device.  However,  in  its  linear  dynamic  region,  the 
F-P  device  is  much  more  sensitive  to  the  sur&ce  charge  density  on  the  mirror; 
thus,  great  control  cS  the  write  light  and  external  voltages  is  required  for  successful 
operation. 

Typical  dectron  deposition  write  mode  is  accomiriished  by  biasing  the  crystal 
at  A  (Figure  3.1)  by  flooding  the  photocathode  with  light,  setting  Vi  to  point  A 
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and  allowing  the  device  output  to  equilibrate  (V^  =  Vg,).  The  image  is  then  written 
by  setting  to  point  C  and  turning  on  the  write  light  for  sufficient  exposure  time 
tw-  This  operation  is  more  difficult  with  the  F>P  device  since  care  must  be  taken 
to  set  V»  accurately  during  the  write  process  to  avoid  over*accumulation  of  charge 
past  C. 

The  electron-removal  mode  is  somewhat  simpler  to  implement  experimentally 
and  is  accomplished  by  first  biamng  the  crystal  at  D.  Then,  with  the  write  light 
on,  Vi  is  ramped  downward  from  D  to  C  volts  at  an  appropriate  rate  V^.  Since 
this  mode  only  requires  that  the  ramp  Vi  and  the  write  light  be  synchronised,  the 
beginning  and  the  end  points  of  the  operation  are  well  defined. 

3.3  Experimental  System 

3.3.1  Prototyp«  Fabry-Perot  MSLM 

A  vacuum-demountable  F-P  MSLM  was  designed,  constructed  and  its  perfor¬ 
mance  evaluated.  The  details  of  the  device  dengn  and  assembly  are  included  in 
Appendix  A. 

An  MSLM  requires  a  vacuum  of  at  least  5  x  10~*  torr  for  the  operation  of  the 
MCP  and  even  lower  for  operation  of  the  photocathode.  The  materials  used  to 
construct  the  MSLM  must  therefore  have  vapor  pressure  well  bdow  these  pres¬ 
sures.  All  hardware  cmnponents  ot  the  MSLM  ,  in  addition  to  the  vacuum  cell 
and  system,  were  scrupulously  cleaned  during  aaaembly  or  modification  of  the 
device.  This  was  accomplished  by  rinsii^  in  trichloroethane  (for  degreasing),  ace¬ 
tone,  methyl  and  a  wash  in  semicmiductor  grade  acetone.  Plastic  gloves 
were  used  in  all  stages  and  dust  was  removed  using  nitrogen  gas.  Since  the  MCP 


111 


CHAPTER  3.  FABRY-PEROT  MSLM 


42 


Stainless  steel  flanges 


MCP 


tHilillitttHISitl. 


Nickel 

electrode 


Teflon 


Crystal 


Fifore  3.2:  Prototjrpe  Fabiy-P«rot  MSLM 

was  shipped  from  the  manufacturer  cleaned  and  under  low  vacuum,  it  was  not 
subjected  to  cleaning.  The  crystal  was  also  not  cleaned,  since  this  would  damage 
the  deponted  coatings  on  its  sur&ces.  Care  was  taken  to  ensure  that  all  handling 
utensils  were  also  cleaned.  Good  vacuum  practice  was  found  to  be  invaluable. 

The  F’P  MSLM  was  mounted  «i  a  152mm  (6.0^  flange  which  mated  to  a 
custom-made  vacuum  cell.  The  vapm  pressure  of  the  cell  was  maintained  at 
about  2  X  lir*  (err  by  a  20  /i(«r/s  Urn  pua^. 

Figure  3.2  contains  a  diagram  of  the  assembled  F-P  MSLM.  Important  features 
of  the  device  components  used  are  summarised  in  TaUe  3.1.  Notice  that  the 
input  window  was  made  of  SI  quarts  and  there  was  no  photocathode;  the  MCP 
was  therefore  directly  illuminated  uring  a  17V  source.  The  high  strip  current 
MCP  had  a  gun  of  about  10*  and  strip  current  of  280  nA  at  -850V.  The 
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Component 

Description 

input  Window 

Si  quarts 

MCi* 

Galileo  ^eetro-Optiee  Corp. 

MCP  #7  -204  -  010 

Diameter:  25mm 

Channel  diameter:  lO^m 

Bias  anfle:  10* 

I,  (at850P):  280  M 

Gain  (at  850^):  2  x  10* 

Vapor  premure:  <  5  x  10—6  torr 

“Gsa 

iTt/Autro^Optieol  Prod,  Div. 
Nickel  mesh 

30  wires/mm 

Transmlasion:  60% 

Mounting  ring  i.d.:  18mm  (0.7*) 
Mounting  ring  o.d.:  22mm  (0.876*) 

Crystal 

s-<ut  tiKbOt 

Thicknem  300  pm 

Diameter:  25mm  (1.0^ 

FUtnew:  ±A/4 

Coatings  by  Babere  Optical  Group 
Dielectric  minors  on  both  sides 
SiOf/ZrOf  (Top  layer  SiOs) 
Reflection:  70%  ±4  % 
Transparent  conducting  electrode 

rro3oon/ 

Transmission:  >  90% 

Output  Window 

SI  quarts 

Table  3.1:  Fabry-Parot  MSLM  cmnponents 
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grid  consisted  of  30  wires/mm,  60%  transmission  nickel  mesh  spot  welded  to  a 
support  ring  with  inner  diameter  18mm  (0.7*).  The  s-cut  LiNbOs  crystal  plate 
was  coated  with  dielectric  mirrors  on  both  sides  and  a  conducting  electrode  on 
one  side  only.  The  dielectric  coating  consisted  of  alternating  layers  of  SiOj/ZrOj 
(top  layer  SiO])  with  a  reflection  A  of  70%±4%  at  a  wavelength  of  633nm.  The 
conducting  electrode  coting  was  FTO  (indium  tin  oocide),  conductivity  200  Q/  and 
transmission  >  905C.  The  crystal  plate  was  300Mm  thick  and  25mm  (1.0*)  in 
diameter.  When  read  out  with  a  coherent  source,  the  crystal  was  found  to  have  a 
single  Haidinger  interference  fringe  around  its  perimeter.  This  indicated  crystal  a 
plane-parallelism  of  about  ±X/4.  Teflon  spacers  were  cut  &om  0.127mm  (0.005*) 
thick  teflon  sheet,  which  was  found  to  be  flexible  enough  to  stay  in  position  without 
warping  and  exerting  pressure  on  the  crystal  or  MCP. 

The  active  diameter  of  the  F-P  MSLM  with  the  configuration  shown  in  Fig¬ 
ure  3.2  is  18mm  (corresponding  to  the  active  diameter  of  the  grid).  Electrical 
connections  are  made  through  high  voltage  feedthroughs  in  the  6.0^  flange.  The 
MCP-to-grid  spacing  was  about  1.6mm,  and  the  grid-to^rystal  spacing  was  about 
0.26mm  for  this  design.  The  most  significant  contributor  to  the  MCP-to-grid 
spacing  was  the  thkknesi  of  the  grid  mounting  ring. 

3.3.2  Power  Requiranentt 

Typical  operating  voltage  reqmremsnts  the  F-P  MSLM  and  the  high  voltage 
supplies  used  are  shown  in  lU>le  3.2.  The  MSLM  controller  was  once  again  used  to 
control  Vt,  the  crystal  vdtage.  The  protective  ballast  resistors  and  power  supply 
connections  are  shown  in  Figure  3.3. 
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Electrode 

Symbol 

Voltage  (kV) 

Supply 

Anode  (MCPin) 

-0.85 

Bertan 

MCP^ 

VMCPoiU 

0 

Grounded 

Grid 

+1.20 

MSLM  Controller 

Crystal 

-1.0  -  +2.0 

MSLM  Controller 

Table  3.2:  Fabry-Perot  MSLM  power  requirements 


3.3.3  Optical  Systems 

The  optical  configuration  in  Figure  3.4  was  used  to  write  and  read  out  information 
from  the  F>P  MSLM.  The  particular  orientation  of  the  MSLM  was  due  to  space 
constraints  in  positioning  the  vacuum  cell.  Notice  that  in  this  case  the  crystal 
was  read  out  interferometrically  so  there  were  no  polarizers  in  the  the  readout 
path.  The  spatial  filter  in  the  transform  plane  separated  the  reflections  due  to  the 
output  window  surfaces  from  the  modulated  readout  signal.  The  readout  imaging 
optics  had  a  magnification  of  4.  The  collimating  and  imaging  lenses  were  high 
quality  Fourier  transform  quality  lenses  from  Space  Optics  Research  Labe.  These 
lenses  ensured  excellent  collimation  of  the  readout  light  and  accurate  imaging 
of  the  output  signal.  The  write  optics  consisted  quite  simply  of  a  Phillips  high 
pressure  mercury  spectral  lamp  as  a  UV  source  and  a  shutter  to  gate  the  light. 
The  iaiiq>  was  positioaed  as  close  as  possible  to  the  input  window  and  isolated 
using  a  cardboard  box  to  prevent  stray  UV  from  reaching  the  MCP  when  the 
shutter  was  closed.  Output  images  were  monitored  once  again  with  the  video 
camera. 


3.3.4  Output  Devicei 
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2N3M6 


Figure- 3.5:  Detector  amplifier  circuit 

Photographs  of  the  readout  signal  were  once  again  made  with  Polaroid  type  55PN 
film  exposed  for  a  controlled  time.  Due  to  the  nature  of  the  F>P  output,  whenever 
the  output  intensity  /«  was  monitored  using  a  detector  in  the  output  plane,  the 
signal  measured  was  localised  by  pontioning  a  pinhole  directly  in  front  of  the 
detector.  As  before,  a  Hamamatsu  Si  PIN  diode  was  used  together  with  the 
circuit  shown  in  Figure  3.5  to  amplify  the  detector  ngnal.  The  voltage 
corresponding  to  /«  was  once  again, 

Vm  »  (3.0) 

where  Vi^rntM  >•  actual  voltage  measured  by  the  detector  and  is  the 

voltage  corresponding  to  the  detector  dark  current  and  the  amldent  room  light 
when  the  data  was  taken. 
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3.4  Device  Performance 

The  reflectivity  R  of  the  dielectric  mirrors  deposited  on  the  crystal  surfaces  and  the 
plane>parallelism  of  the  crystal  surfsces  proved  to  be  the  determining  factors  of  the 
F>P  MSLM  performance.  R  determines  the  flnesse  7  of  the  etalon  (Equation  3.6). 
By  definition,  the  higher  the  /,  the  narrower  the  FWHM  and  the  more  sensitive 
the  etalon  becomes  to  deviations  of  the  crystal  surfaces  from  plane-parellelism. 

The  experimental  F-P  MSLM  had  a  crystal  coated  with  mirrors  of  A  =  0.7. 
This  corresponds  to  a  flnesse  7  of  8.76.  The  crystal  had  a  single  Haidinger  fringe 
around  its  25mm  perimeter  before  device  assembly;  this  corresponds  to  crystal 
surface  plane-parallelism  of  about  o;  ±X/4. 

The  modulator  was  operated  with  an  MCP  bias  of  -SSOV  s  -%S0V) 
and  strip  current  =  280fiA.  The  MCP  was  flooded  with  UV  light  and  the 
grid  voltage  Vf^  slowly  raised  to  -f  1.2JkV.  This  allowed  the  gap  voltage  V,  to 
equilibrate  and  reduced  any  risk  to  the  grid  and  crystal.  The  crystal  voltage 
was  varied  between  —  l.OkV’  and  2.(M;V  and  the  resulting  modulation  observed. 

Figure  3.6  shows  the  output  image  for  the  crystal  biased  with  Vi  =  -0.95A;V. 
The  dark  area  represents  the  part  of  the  crystal  where  the  etalon  pathlength 
results  in  sero  transmisrion  (Equation  3.2).  Unfortunately,  this  proved  to  be 
the  widest  area  of  the  crystal  to  modulate  concurrently.  Lowering  Vi  resulted 
in  inward  movement  of  the  modulation  area  towards  the  crystal  center,  whilst 
gradually  becoming  more  circular  in  shape.  Sixmlariy,  raising  Vi  resulted  in  the 
modulation  area  moving  towards  the  edge  of  the  crystal  until  the  entire  surface 
was  finally  Uased  bright. 

No  ima^ng  could  be  accomplished  using  this  experimental  system,  since  the 
modulation  area  was  not  large  enough.  However,  the  high  finesse  operation  of  the 
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Figure  3.6;  Fabry-Perot  output  image 
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F-P  MSLM  was  characterised  by  positioning  the  detector/pinhole  combination  in 
the  output  plane  in  am  au’ea  of  the  readout  image  that  could  be  modulated,  and 
recording  the  detector  signal  with  a  multimeter,  oscilloscope  or  chart  recorder. 

Figure  3.7  is  a  plot  of  /« (the  intensity  in  the  output  plame),  and  the  correspond- 
ing  plot  of  the  crystad  voltage  The  Fabry-Perot  MSLM  reaulout  characteristic 
was  measured  by  ramping  V*  downward  from  +0.75bV  to  -l.OikV,  while  flood¬ 
ing  the  MCP  with  UV  light.  The  removal  of  charge  from  the  crystad  results  in 
modulation  of  the  readout  signad.  The  transition  vcdtage  V|  was  measured  to  be 
about  700V.  From  Equation  3.8,  V,  is  estimated  by  V,  =  y/FVf  =  3.9kV.  The 
maximum  grid  voltage  Vgru  was  found  to  be  about  2.1kV ;  above  which  the  electro¬ 
static  force  between  the  grid  amd  the  MCP  output  face  caused  inelastic  stretching 
in  the  center  of  the  grid.  Also,  gap  voltages  above  l.OlcV  were  avoided  since  these 
resulted  in  stress  on  the  crystal  and  some  warping  of  the  crystad  plate.  The  MCP 
was  operated  at  -SSOV  (as  compaired  to  —  l.OfcV,  for  the  standard  device)  in  an 
attempt  to  nunindse  the  heating  of  the  crystal  due  to  the  high  strip  current. 

3.5  F-P  MSLM  Image  Processing  Criteria 

The  physical  limitation  on  the  finesse  /  of  a  F-P  MSLM  that  would  be  useful  in 
image  processing,  is  set  by  the  deviation  of  the  polished  electro-optic  crystal  plate 
surfaces  from  plane-parallelism.  The  finesse  f  was  defined  earlier  as  the  ratio 
of  the  separation  adjacent  maxima  to  the  FWHM,  and  is  expressed  in  terms 
of  the  mirrmr  reflectiidty  R  in  Equatim  3.6.  Notice  in  Equation  3.7  that  as  7 
increases,  FWHM  decreases.  By  definition,  the  FWHM(A),  expressed  in  terms 
of  optical  pathlength  in  the  etalon,  is  a  measure  of  the  tolerance  of  the  etalon 
to  deviations  from  plane-parallelism  of  the  crystal  faces.  That  is,  a  region  of  the 
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cr3r8tal  with  thickness  /,  will  modulate  simultaneously  with  all  other  areas  of  the 
crystal  whose  thickness  I  satisfies  the  following, 

(3.10) 

This  can  be  rewritten, 

(3.U, 

If  a  measure  of  the  crystal  plane-parallelism  a  is  defined  as. 


0  5  11-1,1 


(3.12) 


where  7,  is  the  average  crystal  thickness,  and  I  is  the  crystal  tluckness  at  any 
point  of  the  crystal.  For  a  significant  area  of  the  Fabry-Perot  to  modulate  simul¬ 
taneously,  the  following  condition  can  be  derived  &om  Equation  3.11  and  must 
be  satified  throughout  the  modulating  ref^on. 


^  FWHMiA)  X 
®  -  2  ”27 


(3.13) 


That  is, 

(3.14) 

The  result  of  violating  this  condition  was  aptly  demonstrated  by  the  prototype 
F-P  MSLM  built,  where  o  s  A/4  and  /  s  8.76.  Sustituting  into  Equation  3.14, 

7  =  =  3  (315) 

Alternatively  stated,  f  =  8.76  (A  a  0.7)  would  require  a  crystal  with  o  <  A/17.5. 
Thus,  high  I  F-P  MSLMs  ate  severely  limited  by  the  maximum  achievable  plane- 
parallelism  of  the  polished  crystal  surfaces  by  present  technology.  With  the  present 
technology  capable  of  achieving  a  «  s  A/4,  f  is  restricted  to  7  <  2 
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(corresponding  to  R  <  0.25).  These  limitations  are  not  easily  overcome  using 
state-of-the>art  polishing  techniques,  especially  for  the  thin  crystals  required. 

A  possible  alternative  would  be  the  use  of  a  thin  film  modulator  material 
deposited  onto  an  optically  flat  glass  substrate.  This  would  simultaneously  ensure 
the  plane>parallelism  of  the  modulator  and  improve  the  spatial  resolution  of  the 
modulator. 

A  method  for  circumventing  the  plane-parallelism  requirement  (and  enable  use 
of  the  presently  available  crystals),  has  been  suggested  for  use  with  visible  F-P 
MSLMs  which  would  employ  a  photocathode.  In  this  case,  the  crystal  parallelism 
deviations  are  initially  compensated  with  the  appropriate  charge  distribution  be¬ 
fore  any  image  processing  is  done.  This  is  accomplished  by  an  optical  feedback 
conflguration  where  the  reflection  of  a  uniform  readout  light  is  fed  back  to  the 
photocathode  until  the  internal  device  nonunifoimities  are  compensated  and  a 
stable  equilibrium  has  been  attained.  This  method  is  discussed  at  length  in  the 
following  chapter  of  this  thesis. 


Chapter  4 

Optical  Feedback  Configuration 

The  optical  feedback  configuration  of  Figure  4.1  has  been  suue^ted  as  a  means 
for:  (1)  compensating  phase  variations  introduced  by  the  modulator  crystal,  and 
(2)  realising  bistable  operation.  Phase  conpenaation  is  especially  important  for 
high  finesse  Fabry-Perot  MSLMs  which  would  otherwise  have  extremely  strin* 
gent  crystal  plane-parallelism  requirements  for  image  processing,  unattainable  by 
present  polishing  technology. 

The  system  or  input  under  investigation  is  placed  in  the  input  plane  (at  Pi)  or 
in  the  feedback  path  (at  P|).  A  variable  spatially  uniform  amplitude  attenuation 
plate  is  also  placed  in  the  feedback  path  at  P|  to  control  the  feedback  level.  The 
output  is  recorded  in  plane  P$.  Note  that  in  this  case  the  intensity  of  the  signal 
fed  back  is  proportional  to  the  intentity  of  the  output  signal  beam. 

The  crowed  pdarisets  in  Figure  4.1  are  omitted  for  s-cut  crystals  since  these 
are  read  out  interferometrically.  The  MSLM  may  be  operated  in  the  closed  loop 
(feedback)  mode  by  opening  the  shutter  S,  and  in  the  open  loop  mode  by  closing 
the  shutter.  The  MSLM  output  is  monitored  in  the  plane  P9  and  is  equal  to  some 
fraction  of  the  feedback  signal.  A  procedure  for  operating  both  a  standard  or 
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Figure  4.1:  Opticel  feedb^k  conBguretion  of  the  MSLM 
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F&bry-Perot  MSLM  in  this  configuration  would  be: 

1.  compensate,  closed  loop 

2.  bias  crystal,  open  loop 

3.  write  nonlinear  image,  closed  loop 

Phase  compensation  and  bistable  operation  are  accomplished  as  follows.  The 
input  object  is  removed  (uniform  input),  the  feedback  path  is  closed  (5  open) 
and  the  device  is  operated,  preferably  in  the  electron  deporition  mode,  until  the 
readout  intensity  in  plane  Ps  is  uniformly  xero. 

In  this  closed  loop  operation,  areas  of  non-sero  transmittance  of  the  crystal 
will  result  in  feedback  to  the  photocathode  and  depoeition  of  surface  charge  on 
the  corresponding  areas  of  the  crystal  so  as  to  drive  the  transmittance  of  the 
modulator  at  that  region  to  sero.  The  intrinsic  phase  variatimis  of  the  MSLM 
are  thus  compensated  with  the  appropriate  amount  of  surface  charge  and  a  stable 
equilibrium  is  attuned. 

The  device  should  now  be  biased  to  a  bright  background  by  operation  in  the 
open  loop  mode  (5  closed)  and  agra  flooding  the  photocathode  with  light  and 
adjusting  to  add  or  remove  a  uniform  charge  density  while  still  maintaining  the 
phase  compensation  ptoflle.  The  flood  Ught  is  then  shut  off  and  V't  set  to  a  large 
enough  voltage  such  that  the  gap  voltage  Vg  remains  high  enough  to  ensure  linear 
operation  throughout  the  imaging  process. 

The  image  transparency  to  be  processed  is  then  placed  in  then  input  plane 
Pi  and  transferred  by  lens  Lo  onto  the  crystal  with  the  shutter  5  open.  The 
resulting  feedback  signad  is  once  again  ramaged  via  the  feedback  path  onto  the 
photocathode.  In  this  case,  for  a  given  flxed  incidmit  intensity  on  the  input  image. 
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the  high  transmittance  repons  of  the  input  image  will  at  first  result  in  strong 
feedback  and  rapid  deposition  of  sufficient  surface  charge  on  the  crystal  so  as 
to  drive  the  modulator  transmittance  of  those  points  to  sero  (stable  equilibritim) 
within  the  allowed  feedback  time  On  the  other  hand,  low  transmittance  regions 
of  the  input  image  result  in  weak  feedback,  which  will  in  turn  result  in  very  small 
amounts  additional  charge  deposition  on  the  crystal.  Thus,  at  the  end  of  the 
feedback  time  the  transmittance  of  the  modulator  remains  high.  The  MSLM 
stores  these  charge  patterns  and  when  read  out  in  open  loop  mode  using  a  uniform 
source,  a  bistable  image  of  the  input  transparency  results. 

The  theory  of  the  MSLM  operation  in  this  optical  feedback  configuration  can 
best  be  modelled  by  considering  the  behaviour  of  a  sinjfie  pixel  of  the  modulator 
and  neglecting  any  transverse  effects  from  neighbouring  pixris. 

The  intensity  of  the  feedback  signal,  //(t)  can  be  written  as, 

t,{t)  =  Ar(<)  (4.1) 


where  L  is  the  incident  input  intensity  transferred  to  the  crystal,  T(t)  is  the 
particular  time-dependent  traasnuttance  and  t  is  the  dapsed  feedback  time.  J,(t) , 
the  output  rignal  is  smne  fractioo  of  tlw  feedback  signal  (see  Figure  4.2).  For  a 
standard  MSLM,  the  transmittance  r(t)  (from  Equations  2.1  and  2.2)  is  given  by, 


r(t)*sin* 


MO 

2XC 


(nJv  - 


(4.2) 


where  o(t)  is  the  total  accumulated  surface  charge  dcnri^  on  the  crystal  at  time 
t.  In  the  linear  mode  operation  the  incremental  charge  accumulated  in  the  time 
dt  is  derived  from  Equation  2.5  and  is  (pven  by 
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MSLM 

crytUi  PC 


Figon  4.2:  Fvmctional  block  <li«gr«m  of  th«  cloMd-loop  configuntion 
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The  total  charge  density  integrated  on  the  surface  of  the  crystal  at  time  t  is 


therefore. 


where  ao  initial  charge  on  the  crystal.  Equation  4.1  can  now  be  rewritten 


where  !>  the  phase  retardation  due  to  ao  uid  B  is  a  lumped  MSLM  constant. 
For  the  purposes  of  this  analysis,  the  lumped  constant  B,  which  acts  simply  as  a 
scaling  parameter,  is  assumed  to  be  equal  to  1.  The  initial  conditions  at  t  =  0  is. 


/,(^  =  0)  =  /<8in* 


which  is  the  reflection  due  to  the  initial  bias  of  the  crystal.  Notice  that  at  time 


/  '  If{lf)  (ft*  +  ^  =  p)r ;  wherep  =  0,  ±1, ±2, . . . 
/o  2 


and  moreover. 


Once  the  feedback  signal  J/(t)  is  driven  to  sero  at  time  (/,  no  further  charge 
deposition  (Kcors,  so  that, 


//(()  =  Ofor  allt  >  </ 


(4.10) 


and  stable  equilibrium  is  achieved.  Notice  that  for  phase  compensation,  the  shut¬ 
ter  S  must  remain  open  long  enough  to  allow  the  entire  crystal  to  achieve  equi¬ 
librium.  This  behaviour  is  monitored  in  the  output  plane. 
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Alternatively,  for  nonlinear  processing  (e.g.  bistable  operation)  feedback  is 
allowed  only  long  enough  for  areas  of  the  input  with  transmittance  above  some 
threshold  to  be  driven  to  equilibriuan.  The  threshold  transmittance  is  determined 
by  the  feedback  time  t..  In  the  nonlinear  processing  case,  is  such  that, 

Jo  2  (  Y  for  lo^  uiput  transmittance 


Thus  the  modulator  transmittance  will  be  given  by. 


f  0  for  high  input  transmittance 

(*•)  —  I  jjjj*  input  transmittance 


(4.12) 


and  the  desired  bistable  image  will  be  attained  upon  readout  in  the  open  loop 
configuration  with  a  uniform  source. 

The  dynamic  behaviour  of  the  feedback  signal  is  best  analysed  by  numeri¬ 
cally  calculating  and  plotting  //(<).  From  the  fundamental  theorem  of  calculus, 
Equation  4.5  can  be  estimated  as  follows, 


//(t  =  JV  At)  =  4sin*  fx;  //((»  - 1),  At)  At  +  ^ 

ml  ^ 


(4.13) 


where  the  feedback  signal  is  considered  constant  during  the  incremental  time 
interval  At  =  t/N  ;  JV  is  the  number  ctf  time  intervals.  The  initial  condition  is 
still  given  by  Equation  4.6. 

Equation  4.13  can  be  analysed  for  two  cases;  (1)  varying  the  initial  bias  phase 
^  due  to  the  crystal  nonunifomdties,  and  (3)  varying  the  input  intensity  /<  trans¬ 
mitted  by  the  input  transparency. 

Figure  4.3a  contains  plots  of  //(t)  for  multiple  values  of  the  initial  phase  ^ 
with  constant  input  intensity  /<,  The  transmission  will  decay  to  sero  fasttt  than 
the  characteristic  sine-eqaarod  curve  and  equilibrate.  Notice  that  in  cases  where 
^/3  occurs  before  a  of  modulator  transmission,  the  feedback  signal 

will  actually  increase  first  befim  decaying  to  sero. 
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Figim  4J:  Out^  telMltjr  //(<)  «r«tUiidu4  M^M  ia  tht  doMd-k>op  config. 
ttxatkm:  a)  for  coMtamk  iapat  hdiadty  h  with  iaitUl  phut  ^  m  a  paranMtcr, 
b)  f<w  conataat  initial  phaaa  4a  *  **  aiad  with  input  intMdty  aa  a  paraantar, 
*nd  c)  corraapundiat  aodulatar  taaMBMan  r(<) 
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The  effect  of  different  input  intenaitiea  for  the  same  initial  phase  ^  —  r  on 
If{t)  is  shown  in  Figure  4.3b,  and  the  effect  on  the  modulator  transmittance  T(t) 
is  shown  in  Figure  4.3c.  In  this  case,  ^  is  set  at  *  radians  and  the  relative  values 
of  the  input  intensities  varied.  Notice  that  If[t)  (and  thus,  r(t))  decays  to  zero 
more  rapidly  for  higher  input  intensity.  This  supports  the  discussion  on  the  use  of 
this  feedback  configuration  for  nonlinear  applications.  At  some  time  t«,  indicated 
in  Figure  4.3c  redone  with  high  U  are  driven  to  zero  transmittance,  while  those 
with  low  li  leading  to  very  little  additional  charge  deposition,  maintain  relatively 
high  modulator  transmittance. 

A  sixmlar  analysis  has  been  done  for  the  d]mamic  behaviour  of  the  Fabry- 
Perot  MSLM.  For  this  version  of  the  device,  the  transmittance  T{t)  is  derived 
from  Equations  3.3  and  4.1  rewritten  as 

'(I  -  J?)>  -h  4isin*  [b»/o  W)  ^  ‘ 


where  ^  is  again  the  iiutial  bias  phase  and  B'  is  a  lumped  device  constant.  Once 
again,  B*  is  a  scaling  parameter  and  is  assumed  equal  to  1.  The  initial  condition 


The  feedback  signal  will  again  eqnilibrate  at  sero  when  t  >  t/,  where  t/  is  still  as 
defined  in  Equation  4.8.  The  Fabry-Perot  device  will  operate  in  much  the  same 
manner  as  the  standard  device. 

The  high  finesse  Fabry-Perot  device  will  cmnpensate  for  crystal  delations  from 
plane-paralltism  if  sufficient  fwdback  time  is  allowed,  and  can  achieve  nonlinear 
operation  when  the  feedback  time  is  appropriately  limitad.  Equation  4.14  was 
analyaad  numerically  and  phris  were  made  for.  1)  //(()  with  constant  /<,  and 


-  /«4Bsin»(^) 

(l-B)»  +  4Bsin*(^) 


(4.15) 
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different  (shown  in  Figure  4.4a),  and  2)  I/(t)  and  the  corresponding  7(t)  with 
constant  ^  =  ir  and  different  relative  (shown  in  Figure  4.4b  and  c). 

Notice  that  the  intrinsic  nonlinear  characteristics  of  a  high  finesse  Fabry-Perot 
crystal  (iZ  =  0.7)  result  in  similar  nonlinear  behaviour  of  the  feedback  signal 
and  the  modulator  transmittance.  In  nonlinear  operation,  the  threshold  input 
transmittance  can  be  precisely  determined  by  and  the  resulting  bistable  image 
is  significantly  improved  over  that  obtained  with  a  standard  device. 

The  disadvantage  of  unng  this  type  of  feedback  configuration  to  compensate 
for  crystal  deviations  from  plane-parallelism  by  charge  deposition,  is  that  there  is  a 
trade-off  in  dynanuc  operating  range.  Experimentally  the  safe  dynamic  operating 
range  of  an  MSLM  device  is  about  4JtV;  this  limitation  is  imposed  by  arcing 
between  components  and  stresses  due  to  high  electrostatic  potentials.  Consider  a 
standard  device  with  V,]t  ~  12501^;  if  the  IdlSLM  to  be  compensated  has  a  crystal 
with  plane-parallelism  factor  (see  Equation  3.12),  a  =  A/4,  then  the  crystal  will 
require  about  V,it/2  =  625V  equivalent  charge  compensation  in  some  areas.  Thus, 
about  15%  of  the  available  operation  range  is  utilised  in  compensation,  leaving 
over  3kV  to  work  with;  not  unreasonable  for  a  crystal  with  V,jt  =  1250  (full 
modulation  can  be  realised  for  a  grid  voitage  of  1  —  2kV). 

However,  the  compensation  trado4>ff  is  much  more  severe  in  the  case  of  the 
Fabry-Perot.  Consider  a  device  with  a  s-cut  LiNbOs  cr]rstal,  V,  s  3100V ;  once 
again  aasuniinf  e  »  A/4,  the  crystal  will  require  Vv/2  =  1550V  equivalent  charge 
compensati<m.  This  is  about  of  the  available  operating  range,  leaving  only 
about  2450V  with  wUch  to  work.  Although  this  range  is  greater  than  the  voltage 
required  for  a  U^t  to  dark  transition  (600  -  800V;  J{  =  0.7),  if  the  grid  voltage  is 
1  -  2A;V,  no  allowance  would  be  made  for  the  fut  that  the  precise  thickness  of  the 
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Figure  4.4:  Output  intensity  I/(t)  of  n  Febry-Perot  MSLM  in  the  closed-loop  con¬ 
figuration:  s)  for  constant  write  intensity  4  initial  phase  4o  **  o  parameter, 
b)  for  constant  initial  phase  do  ^  ond  with  write  intensity  4  as  a  parameter, 
and  c)  corresponding  modulator  transmission  T(t) 
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crystal  can  be  as  much  as  (n  +  |)A,  where  n  is  an  integer  and  X  is  the  wavelength 
of  the  readout  light.  Thus,  the  cr3r8tal  would  be  biased  in  the  neighborhood  of 
the  central  flat  region  of  the  Fabry-Perot  characteristic.  This  additional  fraction 
of  a  wavelength  must  be  accounted  for  experimentally  by  properly  biasing  the 
operating  voltages  and  in  the  worst  case  can  require  as  much  as  V*.  =  3100V. 

The  ability  to  compensate  internal  device  phase  variations  is  critical  for  imag¬ 
ing  with  a  Fabry-Perot  MSLM  using  currently  available  crystals.  However,  the 
amount  of  phase  compensation  that  can  be  tolerated  while  leaving  sufficient  op¬ 
erating  range,  is  limited  by  the  precise  crystal  thickness  deviation  from  an  integer 
multiple  of  A,  and  the  voltage  limitations  imposed  on  the  device. 
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Chapter  5 

Variable  Gamma  Operation 


The  goal  of  the  work  described  in  this  chapter  was  to  convert  the  inherent  peri¬ 
odic  characteristic  of  the  MSLM  (Figures  2.6  and  3.1)  to  a  switching  characteristic 
useful  in  nonlinear  processing  by  choice  of  operating  mode.  The  next  Section  5.1 
contmns  a  description  of  the  conventional  gamma  characteristic  used  for  describ¬ 
ing  the  switching  characteristics  of  photographic  emulsions.  This  is  followed  by 
a  disciission  of  the  desired  svntching  behaviour  and  the  parameters  which  char¬ 
acterise  the  response  of  the  MSLM.  The  following  sections  describe  the  operating 
modes  which  were  used  to  convert  the  periodic  MSLM  characteristic  to  a  switch¬ 
ing  characteristic  and  an  analysis  oi  the  modulator  transmittance  with  respect  to 
the  individual  operating  parameters. 

The  techiuques  for  achieving  the  desired  MSLM  characteristics  are: 

e  Electron  deposition/grid  stabilised  mode 

•  Electron  deplerion/adjustable  ramp  rate,  fixed  terminal  ramp  voltage  {Beat- 
Time  BardeKpped  ThnshoUinf  Mode) 
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Figure  5.1:  Conventional  gamma  characterietic  for  photographic  film 

5.1  Switching  Characteristics 

5.1.1  Conventional  Gamma  Characterietic  of  Photographic 
Film 

Recall  that  the  gamma  characterietic,  defined  for  conventional  photographic  emul* 
sions,  is  a  plot  of  log  l/T  vs.  log  E\  where  T  is  the  readout  intensity  transmission 
and  £  is  the  corresponding  input  exposure  (see  Figure  5.1).  The  input  exposure  is 
the  product  of  the  incident  exposure  /«  and  the  exposure  time  t«.  For  a  negative 
gamma  charact^ic  the  readout  tight  remmns  in  the  ON  state  (high  T)  for  input 
exposures  below  threshold  Fm,  and  is  OFF  (low  T)  for  exposures  above  saturation 
The  gamma  7  of  the  device  is  the  slope  of  the  linear  rei^on  of  the  curve. 
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and  is  given  by, 

^  logiE^/Etn)  ^  ’ 

The  gamma  characteristic  is  more  commonly  referred  to  as  the  Hurter-Driffield  {H 
and  D)  curve  in  the  photographic  world,  and  is  the  most  widely  used  description 
of  the  photosensitive  properties  of  photographic  film.  Typical  values  of  gamma 
for  low  contnut  film  are  1  or  less,  and  for  high  eontraot  films,  2  or  3  [11]. 

The  gamma  characteristic  for  film  is  uniquely  defined  in  terms  of  the  threshold 
Eih  and  saturation  Etaii  that  is,  there  is  a  single  unique  gamma  associated  with 
a  given  emulsion.  The  logarithmic  nature  of  the  T  —  E  relationship  allows  the 
value  of  7  to  be  conveniently  determined  with  respect  to  either  /«  or  the 
log  decouples  the  gamma  dependence  on  the  the  product  log(/«t«),  to  the  sum 
of  log(/«)  and  log(t«).  Thus,  7  may  be  measured  by  either  varying  /«  or  t^. 
Note  that  while  it  may  be  posnble  to  vary  the  threshold  and  saturation  exposure 
through  the  development  process,  and  thus  obtain  a  different  value  for  7,  the 
switching  nature  of  the  gamma  characteristic  is  preserved.  A  positive  gamma 
characteristic  requires  two  recording  steps  if  one  starts  with  a  negative  film. 

6.1.2  Desired  Switching  Characteristic  of  an  MSLM 

The  ABC  le^on  of  the  standard  MSLM  characteristic  and  that  of  the  Fabry-Perot 
version  (Figure  5.2)  closdy  apprmdmates  the  corresponding  repon  of  the  gamma 
characteristic  of  film  (Figure  5.1).  Howew,  the  periodic  nature  of  the  MSLM 
readout  characteristics  precludes  the  unique  definition  of  threshoid,  saturation 
and  7  for  the  MSLM.  By  properly  operating  the  device,  the  desired  switching 
characteristic  shown  is  Figure  5.3  can  be  attained;  in  this  esse,  the  device  is 
forced  to  follow  the  curve  ABCD  instead  of  its  nrninal  characteristic  by  choice  of 
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Figar*  5  a)  PoUrisation  riadoat  tranwniwiop  eharactarwtk  of  an  obliqtt*<ut 
LiNbOt  cryatal  and  b)  intarfaronintric  raadont  tramndnion  characteristic  of  a 
Fabry-Pttol  cryatel  with  R»0.7 
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Ftgore  5.3:  Desired  MSLM  switching  characteristic 
operating  mode. 

According  to  Equation  5.1  the  value  of  7  is  dependent  on  the  ratio  E^tJEth 
of  the  quasUinear  region  in  the  log— log  plane;  this  ratio  will  be  single>valued 
for  a  given  photograpUc  emulsion.  However,  the  MSLM  initial  bias  point  A 
may  be  set  anywhere  along  the  characteristic  curve  by  initially  depositing  the 
appropriate  suifMe  charge  04  on  the  crystal.  For  a  pven  bias  point,  there  will 
be  an  assofiated  threshold  exposure  £#  and  saturation  exposure  Ec-  The  ratio 
of  the  saturation  to  threshold  exposure  BcIBb  >*  therafore  bias  dependent,  and 
thus,  7  will  also  be  bias  dependnt.  Notice  that  although  the  value  obtained  for 
7  in  the  log  1/r  vs.  U»gB  plans  changes  with  the  initial  Mas,  the  slope  of  the 
iiasar  transition  region  of  ths  intrinsic  MSLM  characteristic  in  the  T  -  E  plane 
is  uniquMy  deSned.  This  dilemma  is  sspecially  apparent  in  ths  caas  where  the 


141 


CHAPTER  5.  VARIABLE  GAMMA  OPERATION 


72 


MSLM  bias  A  is  very  close  to  the  threshold  at  point  B.  In  this  case,  Eb  ^  0 
and  '1  becomes  undefined;  however,  the  output  response  of  the  device  may  still  be 
predicted  using  the  readout  switching  characteristic. 

These  observations  indicate  that  the  definition  of  the  conventional  gamma 
characteristic  for  photographic  emulsions  is  inappropriate  for  describing  the  switch¬ 
ing  behaviour  of  the  MSLM.  Instead,  the  MSLM  is  better  characterised  by  the 
respective  readout  transmission  characteristic  in  a  linear  T  —  E  plot. 

Thus,  the  slope  of  the  transition  BC  region  inT  —  E  plots  indicated  in  Fig¬ 
ures  5.2  and  5.3  will  be  used  to  describe  the  MSLM  switching  behaviour.  The 
initial  bias  of  the  MSLM  at  point  A  serves  as  the  modulator  input  exposure  ref¬ 
erence  pmnt  and  p<Mnts  B  and  C  correspond  to  the  threshold  and  saturation, 
respectively.  For  convenience  Eb  and  Ec  are  defined  at  009B  and  10%  transmis¬ 
sion  of  the  modulator  readout  intensity.  The  slope  S  in  the  linear  repon  of  the 
T  ^  E  curve  for  the  modulator  is  given  by, 


dT  Tc-Tb 
dE  Ec  ~  Eb 


(5.2) 


The  definition  of  the  slope  5  is  now  independent  of  the  initial  bias  A.  Both 
negative  and  podtive  values  of  5  are  posdble. 

Notice  that  the  exposure  dependence  E  of  the  slope  can  no  longer  be  decou¬ 
pled  with  respect  to  and  t«  as  in  the  case  of  photographic  film;  instead,  both 
quantities  must  now  be  measured  to  evaluate  5.  The  slope  5  has  units  of  trans¬ 
mittance  times  invsces  exposure,  and  can  be  conddered  as  a  measure  of  the  device 
rupon$€  or  ssiwitioity  to  the  input  exposure.  Altemativdy  stated,  5  measures 
the  change  in  the  device  transmisdon  per  unit  input  exposure.  A  ki§H  value  of  S 
implies  a  high  device  (Ugh  device  response  to  exposure),  wUle  a  tow 

value  of  5  implies  tow  urmHvUy  device  (low  device  rsspmtss  to  exposure).  A  lugh 
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S  device  is  therefore  desirable  in  nonlinear  operations  requiring  rapid  switching 
in  the  output  transmission. 


5.2  Electron  deposition/Grid  stabilized  Mode 


Both  the  standard  and  the  Fabry-Perot  MSLM  may  be  operated  in  the  electron 
depoeition/grid  stabilized  mode.  This  is  accomplished  by  first  biasing  the  crystal 
with  a  bright  background  at  point  A,  setting  the  grid  voltage,  Vg,i4  to  point  C 
(the  voltage  required  to  deposit  the  required  surface  charge  to  bias  the  crystal  at 
point  C).  The  image  is  then  written  by  exposing  the  photocathode  to  the  write 
light  for  a  specified  write  time  <«.  Thus,  areas  of  input  exposure  below  Eb 
will  be  barely  recorded,  those  above  Ec  will  saturate  at  C  since  the  grid  voltage 
prevents  further  charge  deposition,  and  exposures  in  between  are  determined  by 
the  slope  5. 

In  the  electron  deposition/grid  stabilised  mode  of  operation,  the  value  of  S 
obtained  is  intrinsic  to  the  particular  MSLM  device  t]rpe.  The  device  parameters 
which  detenmns  the  intrinsic  modulator  slopes  for  both  the  standard  and  F>P 
MSLMs  are  examined  as  fdiows. 

The  rine^uared  characteristic  of  a  standard  MSLM  is  approximately  linear 
for  transmissioQ  between  10%  and  00%.  The  slope  of  this  linear  region  may  be 
approximated  to  edthin  15%  mot  by  the  value  of  the  derivative  at  half-maximum 
(r  s  (n  +  |)ir,  n  integer)  by  the  following  method  (neglecting  sign  for  now). 
Consider, 


^  =  1 


(5.3) 
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From  Equations  2.1, 2.3  and  2.5,  obtain. 


r  _  ^  E 

CV^j,  [cV,ti  hu  J. 


where  8  refers  to  [•]  evaluated  using  the  appropriate  standard  MSLM  parameters. 
The  slope  S  can  now  be  estimated, 

^  .  dT  irveG  1 


dE  2  l( 


•  dE  2  [CV,Khu\,  '  ' 

The  Fabry-Perot  version  of  the  MSLM  is  much  more  difficult  to  analyse  using 
the  above  technique.  Instead,  the  eorrurs  of  the  Fabry-Perot  curve  are  assumed 
to  be  sharp",  once  again  neglecting  the  sign.  Equations  3.6  and  3.7  lead  to  the 
following, 

_ l _ =£  (5.6) 

iff  FWHMit)  2ir  *  ' 

From  Equations  2.5,  3.1  and  3.5,  obtain. 


ir<r(^)  _  r  ir  qg<7] 
CV,  [cv,hu\,.p 


where  F-P  refers  to  [■]  evaluated  using  the  Fabry-Perot  device  parameters.  Now, 
the  slope  S  can  be  estimated. 


s  ^  =  L 

^*'^~dE  2k[cV^v\p.p 


In  both  cases  the  photocathode  quantum  efficiency  q  and  MCP  gain  G  increase 
the  device  response,  wUle  the  crystal  capacitance  C  and  halfwave  voltage  V, 
decrease  the  response  as  expected.  However,  in  the  case  of  the  F-P  device,  there 
is  an  additional  &ctor  7/x  contributing  to  5.  This  makes  a  high  finesse  F- 
P  modulator  significantly  more  desirable  in  nonlinear  operations.  Consider  a 
standard  and  a  F>P  device  (mirror  reflectivity  R  —  0.7);  then,  if  (*]«  sf  [']y-P<  the 
ratio  of  the  device  slopes  will  be  about, 

a  -  =  2.8  (5.9) 
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The  F-P  version  sensitivity  is  a  factor  of  2.8  greater  than  the  standard  device. 
Thus,  full  light*to-dark  transitions  can  be  achieved  with  much  less  input  exposure. 

As  mentioned  before,  the  slope  obtained  in  this  operating  mode  is  intrinsic  to 
the  device  and  is  dependent  on  the  appropriate  device  parameters.  This  slope  is 
independent  of  the  incident  intensity  and  exposure  time  used.  This  is  especially 
significant  in  the  following  section  which  describes  the  hardclipped  thresholding 
mode  which  modifies  the  intrinsic  behaviour  of  the  device  and  is  characterised 
with  respect  to  the  write  intensity  and  the  write  time. 

Measurements  of  the  absolute  input  intensity  level  on  the  photocathode  re¬ 
quiring  carefully  calibrated  detectors  were  not  conducted,  so  that  the  absolute 
numerical  values  for  S  were  not  evaluated.  However,  calibrated  neutral  density 
filters  were  used  to  attenuate  the  incident  intensity  in  a  controlled  manner,  and 
thus,  enabled  analysis  of  the  experimental  data  with  respect  to  relative  intensity 
levels. 

Figure  5.4  shows  the  data  obtained  using  the  standard  Hamamatsu  MSLM. 
The  plot  of  the  raw  data  vs.  t«,  where  /mmu  is  the  detector  measurement 
corresponding  to  the  intensity  /,  in  the  output  plane.  While  the  write  intensity 
level  was  not  measured,  because  it  remained  constant  throughout  the  measure¬ 
ment,  the  elapsed  write  time  was  proportional  to  the  input  exposure  {E  —  /•<•). 
The  best  fit  to  the  data  by  linear  regression  is  also  shown  as  a  solid  line  in  the 
figure. 

The  F-P  MSLM  intrinsic  characteristic  was  also  measured,  but  in  this  case  a 
chart  recorder  was  used  to  plot  the  amplified  detector  signal  directly.  Figure  5.5 
shows  a  plot  of  /*tMt  t*  fof  the  prototype  F-P  device  that  was  built.  Once 
again  the  input  write  UV  intenrity  was  constant  but  unmeasured.  According  to 


inteotity  /•(~  T) 


CHAPTER  5.  VARIABLE  GAMMA  OPERATION 


76 


Figun  5.4:  /«  y».  for  lUndard  Hamunateu  MSLM 
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the  time  scale  for  these  typical  write  intensities  used  in  recording  the  intrinsic 
device  5,  the  F-P  is  probably  more  sensitive  than  the  standard  device.  Absolute 
values  of  the  slope  S  would  require  measurement  of  the  average  write  intensity  at 
the  appropriate  wavelength  of  write  light. 

The  quasilinear  behaviour  of  the  MSLM  is  apparent  in  both  cases  and  the  va¬ 
lidity  of  using  a  linear  model  in  the  tranrition  SC  re^on  of  Figure  5.3  is  substan¬ 
tiated.  While  this  mode  of  operation  is  capable  of  achieving  the  desired  switching 
characteristic,  it  is  not  the  preferred  mode  of  operation.  This  is  because  the  sat¬ 
uration  point  C  is  not  well-defined  experimentally  and  proximity  focuring  is  lost 
when  areas  of  the  crystal  saturate  near  the  grid  voltage.  This  loss  of  proximity 
focusing  results  in  degradation  M  the  images  that  are  recorded.  The  second,  more 
preferred  technique  is  described  below. 


5.3  Real-Time  Hardclipped  Thresholding  Mode 

Both  the  standard  and  F-P  MSLh&  can  be  <q>erated  in  the  hardclipped  thresh¬ 
olding  mode  to  vary  their  intrinsic  characteristics.  To  operate  the  MSLM  with  a 
negative  slope  characteristic,  the  device  is  first  biased  with  a  bright  background 
at  point  A  in  Figure  5.3.  The  grid  voltage  Vf,i4  is  set  at  point  C,  then  with 
the  optical  image  inddent  on  the  photocathode,  the  crystal  voltage  is  ramped 
downward  from  pdnt  A  at  some  pie  selected  rate  Pk,  to  a  terminal  voltage  which  is 
usually  selected  to  be  the  grid  voltage.  The  rate  Vt  sotablishcs  both  the  threshdd 
exposure  Eg  (corresponding  to  the  initial  Idas  A)  and  the  slope  S.  All  exposures 
bdow  Eg  will  be  barely  recorded  and  remdn  in  the  ON  state;  those  above  Be 
will  saturate  at  the  grid  voltage  (OFF  state);  and  the  exposures  in  between  will 
be  determined  by  5.  Remember  that  the  output  intensity  is  proporti(»aI  to  the 
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device  transmittance  T. 

Experimental  results  were  obtained  using  the  standard  Hamamatsu  MSLM. 
As  mentioned  previously,  due  to  the  voltage  limitations  for  this  particular  device, 
slopes  were  meastired  in  an  operating  region  around  the  ^,^4  pmnt. 

Variable-gamma  and  variable-threshold  operation  was  achieved  by  varying  the 
ramp  rate  (that  is,  the  write  time  from  A  to  C),  and  the  relative  write  inten¬ 
sity  /«.  The  write  intensity  was  varied  using  a  uniform  write  light  attenuated  by 
calibrated  neutral  density  filters  to  obtain  different  values  for  /«  on  the  photocath¬ 
ode.  Unlike  photographic  film,  the  results  demonstrated  that  both  the  threshold 
exposure  and  the  sensitivity  (5)  of  the  device  depended  on  the  specific  values  of 
tw  and  /•  during  the  write  operation. 

Figure  5.6a  is  a  graph  of  T  vs.  with  as  a  parameter,  where  T  is  the 
readout  transmittance,  is  the  write  time  and  /«  is  the  write  light  intensity. 
Each  plot  was  made  with  a  constant  /«  of  arbitrary  units.  Notice  that  the  slope 
of  these  plots  dT/dt^  Increases  and  the  plots  shift  left  for  increasing  /«.  This 
in^catcs  that  the  threshold  decreases  when  the  /«  is  increased.  Conridering  only 
the  tranrition  re^on  of  the  switching  characteristic,  the  slope  5  (/«)  in  the  T  -  E 
plane  is  pven  by, 

and  is  plotted  in  Figure  5.6b  as  a  function  of  /«. 

Figure  S.7a  is  a  graph  of  T  vs.  /«,  with  as  a  parameter.  Each  plot  was 
made  with  a  constant  and  intensity  of  arbitrary  units.  Once  agmn  the  slope 
d7/d/«  increases  with  increasing  (decreasing  raiiq>  rate  H),  but  in  this  case  the 
threshold  exposure  is  not  rigitificantly  changed.  Considering  only  the  transition 


Figtm  8.6:  H«rdclipp«d  UiNsliokUiig,  with  /«  m  a  paramsttr:  a)  T  vs.  t 
b)  S(/.)  va.  /. 
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Fifon  5.7:  Haxdclipped  thr«hdding,  with  is  «  panmeter  a)  T  ve.  /«  and 
b)  5(<«) 
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region,  the  slope  $  (t^)  in  the  T  —  E  pl&ne  is  given  by, 

SM  =  ~  (su) 

and  is  plotted  in  Figure  5.7b  as  a  function  of 

Notice  that  in  Figure  5.6b  the  sensitivity  S  increases  with  increasing  write  in¬ 
tensity  /«.  This  can  be  understood  by  considering  the  following.  If  the  write  light 
intensity  were  equal  to  sero  then  one  would  expect  no  response  from  the  device, 
or,  equivalently  stated,  the  slope  S  would  be  sero.  As  the  light  intensity  was  in¬ 
creased,  the  device  seiuitivity  would  also  increase,  as  indicated  in  the  graph.  One 
would  expect  at  some  point,  further  increasing  of  the  write  light  intensity  would 
result  in  a  decrease  in  the  derivative  of  the  slope;  since  the  device  is  incapable 
of  responding  to  an  infinite  range  in  input  intensity,  and  eventually  satriration  of 
S  is  approached.  At  saturation,  the  MCP  is  emitting  the  maximum  number  of 
electrons,  independent  of  any  further  increase  in  the  write  light  intensity,  so  that 
the  additional  light  intensity  above  the  MCP  saturation  is  essentially  wasted,  and 
the  sensitivity  of  the  device  remains  at  some  maximum  value. 

Similar  observations  may  be  made  with  respect  to  the  results  shown  in  Fig¬ 
ure  5.7b.  In  this  case,  the  sensiUvity  $  decreases  with  increasing  write  time 
(corresponiUng  to  decreasing  ramp  rate  V»).  This  is  a  direct  result  of  the  efficiency 
edth  which  the  secondary  emission  electrons  are  collected  by  the  grid.  For  the 
case  when  the  write  time  is  short  (fast  ramp  rate),  electrons  are  rapidly  removed 
from  the  cr]rstal  and  collected  by  the  grid,  so  that  the  electron  ccdlection  process 
is  relatively  efficient,  and  the  device  senritivity  high.  As  the  write  time  increases 
(decreased  ramp  rate),  the  collection  of  electrons  by  the  grid  becomes  more  in¬ 
efficient  and  is  finuted  by  the  ramp  rate  of  the  voltage,  resulting  in  a  decrease 
in  the  effective  device  response.  That  is,  the  effective  sensitivity  of  the  device  is 
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not  limited  by  the  write  light  intensity,  but  by  the  rate  at  which  the  electrons  are 
being  removed  from  the  surface  the  crystal  (low 

Figure  5.8  shows  the  results  after  threshc^ding  a  gray  scale  image  of  an  M.I.T. 
student  with  increasing  write  times.  H’^er  (more  nonlinear)  operation 

would  have  been  achieved  for  operation  in  the  neighborhood  of 

The  F-P  MSLM  could  also  be  operated  in  the  hardclipped  thresholding  mode 
to  achieve  even  higher  sensitivity  than  the  intrinsic  device  response.  However, 
there  is  no  need  to  operate  the  F*P  in  such  a  manner  if  the  finesse  is  made  suffi¬ 
ciently  high  to  attain  the  desired  switching  characteristics.  Naturally,  according 
to  the  limitations  discussed  in  Chapter  3,  there  is  some  limit  to  the  allowed  J 
imposed  by  the  crystal  plane-parallelism. 


Chapter  6 

Optical  Information  Processing 

6.1  Applications  Discussion 

The  versatility  offered  by  a  high-resolution,  optically-addressed,  variable-gamma 
spatial  light  modulator  makes  it  suitable  for  a  vast  number  of  optical  information 
processing  applications  (12,13]. 

At  present,  there  exists  a  need  to  replace  photographic  film  as  the  basic  com¬ 
ponent  of  optical  processing  and  filtering  systems.  If  optical  computers  are  to 
achieve  th«r  full  potential  for  high  speed  paralld  data  throughput,  then  real¬ 
time  reusable  devices  must  become  available.  Such  spatial  light  modulators  are 
necessary  in  thres  esssntial  areas: 

•  in  the  input  data  plane  for  amplitude  or  phase  modulation  of  a  coherent 
wavefront 

•  in  the  Fourier  transfora  filter  plane  of  an  <9ticai  system  for  2-D  optical 
filtering 

•  in  the  output  data  plane  for  recording  output  of  the  processing  system 
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The  poeitive/negative  variabie-gamma  capabilities  further  enhance  the  advan¬ 
tages  of  the  MSLM  for  general  purpose,  real-time  linear  and  nonlinear  (bistable) 
optical  processing.  This  section  briefly  reviews  a  few  such  applications.  The 
particular  application  of  the  MSLM  in  real-time  halftone  screen  processing  is  dis¬ 
cussed  in  the  following  section. 

Operation  in  a  linear  mode  would  allow  the  device  to  be  utilised  in  most 
conventional  linear  procesang.  These  applications  include  pattern  recognition, 
Fourier  plane  filtering,  and  real-time  holography.  As  an  example,  it  is  possible 
to  use  the  MSLM  in  the  input  data  plane  a  coherent  optical  processor  for 
incoherent-to-coherent  image  conversion,  or  in  the  Fourier  plane  as  a  2-D  ad¬ 
justable  optical  filter  in  pattern  recognition,  and  in  the  output  plane  as  a  storage 
meditim.  This  stored  image  may  then  be  used  as  the  input  to  another  optical 
system,  since  the  MSLM  is  cascadable;  this  feature  also  allows  utilisation  in  feed¬ 
back  processing  systems.  All  of  these  operations  can  be  performed  in  real-time  and 
preserve  the  inherent  advantages  of  optical  systems.  These  simple,  yet  powerful 
operations  are  basic  building  blocks  in  conventional  linear  processing. 

Bistable  modes  of  <q)eration  are  particulariy  attractive  for  the  realisation  of  a 
large  number  of  2-D  nonlinear  processing  opnations. 

A  Itigh-gamma  MSLM  can  be  ussd  directly  as  a  nonlinear  device  to  demon¬ 
strate  appUcations  such  as  intensity  levd  slicing,  logic  operations,  bistability,  A-D 
conversion  and  thresholding.  These  operations  are  performed  in  both  open  loop 
and  closed  loop  (feedback)  configurati<ws  and  have  been  discussed  in  this  thesis 
and  dsewhere  [10];  such  operatimis  are  important  for  both  image  processing  and 
development  of  a  futuristic  optical  digital  conq>uter. 

There  exist  several  co<ting  and  modulation  techniques  that  are  essential  for 
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the  implementation  of  many  nonlinear  filtering  operations  by  means  of  coherent 
optical  systems.  The  most  commonly  tised  of  these  are  the  halftone  screen  process 
and  theta  modulation  [13].  In  nonlinear  procesmng,  operations  such  as  logarithmic 
transformation,  exponentiation,  level  slicing,  multiple  image  isophote  generation, 
subtraction  and  multiple  image  storage  can  be  implemented. 

This  thesis  examines  the  application  of  a  standard  MSLM  operated  in  the  hard- 
clipped  thresholding  mode  to  implement  halftone  screen  processing  and  achieve 
a  wide  nmge  of  possible  real-time  nonlinear  image  and  signal  processing  applica¬ 
tions  [lOj  such  as  histogram  mimsurement,  density  slicing,  density-based  artificial 
stereo  and  equidenntometry  (isophote  production). 

6.2  Halftone  Screen  Process 

The  objective  of  the  halftone  screen  process  is  to  perform  intensity  to  spatial 
frequency  conversion  on  the  input  image  so  tliat  subsequent  Fourier  plane  filter¬ 
ing  results  in  the  desired  nonlinear  operation  [14,15,16,17,18].  This  modulation 
step  is  also  called  tpatuU  pulte-frequency  moduiation.  Modulation  is  accomplished 
through  the  use  of  a  contact  screen.  This  contact  screen  is  composed  of  an  array 
of  cells  vnth  one-  and  two-  cUmensional  frequency  and  transmittance  variations 
witlun  each  cell,  A  continuous-tone  input  image  E{x)  is  sandwiched 

together  with  the  contact  screen  and  the  combined  transparency  is  imaged  onto 
a  high-gamma  (ideally  infinite)  storage  guch  as  the  nonlinearly  oper^ 

ated  MSLMi  discusMd  in  this  thesis.  The  resulting  halftone  image  consists  of  a 
periodic  array  of  area-modulated  cells  (see  Figure  6.1  [14]). 

Since  the  modulation  step  is  enentially  a  sampling  process  (the  intensity  levels 
are  encoded  as  binary  pulses  of  varying  area),  the  frequency  of  the  contact  screen 
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Figiire  6.1:  Halftone  screen  procening:  basic  concept  (14j,  a)  linearly  varying 
input  E(x),  b)  contact  screen  transmission  profile  r(z),  c)  incident  exposure  on 
high-gamma  storage  medium  E(z)T(x)  with  threshold  Etk,  d)  Area  modulated 
cells 


I 


158 


CHAPTER  6.  OPTICAL  INFORMATION  PROCESSING 


89 


must  be  sufficiently  high  so  that  within  a  unit  cell,  the  transmittance  of  the  input 
transparency  is  essentially  constant. 

The  modulated  halftone  image  is  then  fed  into  the  input  plane  of  a  coherent 
optical  processor  which  separates  the  variotis  density  levels  into  specific  spatial 
frequency  domains  within  the  Fourier  plane.  The  amount  of  diffraction  is  de¬ 
termined  by  the  cell  separation  in  the  halftone  image,  and  is  thus  a  function  of 
the  MSLM  threshold  level.  With  proper  design  of  the  screen,  spatial  filtering  in 
the  Fourier  plane  can  be  effectively  utilised  to  achieve  a  wide  range  of  nonlinear 
processing  operations  [16,17,18]. 

The  transmittance  profile  of  the  contact  screen  that  was  actually  used  to 
perform  the  halftone  screen  processing  was  provided  by  H.  K.  Liu  of  the  Jet 
Propulsion  Lab,  and  is  shown  in  Figure  6.2a.  Consider  a  y-slit  extended  in  the 
x-direction,  extracted  from  the  center  oS  the  cell  with  the  intensity  profile  of  Fig¬ 
ure  6.2b.  The  unit  slice  has  10  blocks  with  5  transmission  levels  Te  —  Tiq.  Given 
a  source  of  constant  input  intensity  /q,  the  intensity  incident  on  the  spatial  light 
modulator  due  to  a  typical  slice  within  the  unit  cell  is  given  by, 

/«n>  —  loTtyTn  i  W  =  6 . . .  10  (®*l) 

where  n  is  the  label  denoting  the  block  transmission  level,  amd  To  is  the  trans¬ 
mittance  of  the  locad  input  image  intensity  (assumed  constamt  over  the  unit  cell 
area).  Notice  that  I^  > 

When  the  MSLM  is  operated  in  the  hardclipped  thresholding  mode,  the  switch¬ 
ing  characteristic  discussed  in  Section  5.1  results,  and,  S  and  1^  (threshold  inten¬ 
sity)  are  determined  by  (Equation  6.1).  That  is,  for  fixed  input  intensity  Iq 
such  that  IwiQ  <  liht  then  all  block  intennties  I^  will  be  less  than  and  the  cell 
slice  will  have  uniform  transmittance;  the  modulator  readout  light  from  the  cell 
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T^{x,y)  Cell  tmumittance  profile 
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Figure  6.2:  Profile  of  the  contact  screen  utiliied:  a)  2-D  profile  b)  y-slit  extended 
in  x<direction 
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/u  level 

Grating  carrier  frequency 
fgnt  n  block  index 

Ith  >  ImlO 

IwlQ  Iw» 

/«r»  >  Iik>  Iw» 

Imt^  Itk>  ImT 
Im1  >  Itk>  I^ 

^  Ith 

/fio  —  0  unmodulated 

f  *  f 

/*•=  y.y 
/#T  =  r»  F 

/fS  =  y,  y 

opaque 

Table  6.1:  Pulse  frequency  modulation:  Grating  carrier  frequency  corresponding 
to  /(* 


will  be  spatially  unmodulated  (grating  carrier  frequency  fgio  of  sero).  Similarly, 
for  /aio  >  ItM  >  /msi  the  modulator  readout  light  from  that  cell  will  be  modu¬ 
lated  by  grating  carrier  frequency  ffi  =  l/X.  Further  modulation  results  can  be 
extended  to  2-D  and  are  summarised  in  Table  6.1. 

When  this  pulse-frequency  image  is  injected  into  a  coherent  optical  processor, 
the  diffraction  spot  at  spatial  frequency  coordinate(s)  /s,^  =  /^/fn  in  the  Fourier 
plane  will  contain  the  information  corresponding  to  points  in  the  input  image 
governed  by  /^. 

Some  example  experiments  that  may  be  performed  are  as  follows: 

•  A  histogram  of  the  original  image  is  obtained  by  measuring  the  intensities 
of  the  spots  in  the  Fourier  plane. 

•  Perform  equidensitometry  by  passing  different  orders  in  the  Fourier  plane. 

•  Enhance  output  image  contrast  by  placing  neutral  density  filters  that  have 
higher  densities  for  lower  intenrities  behind  the  diffraction  spots  and  stop¬ 
ping  all  other  diffraction  spots. 

•  A  pseudo-color  image  is  obt^ned  by  using  a  white  light  readout  source 
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instead  of  a  monochromatic  source  and  a  set  of  color  filters  placed  in  the 
Fourier  plane  to  selectively  pass  certun  colors. 

•  Artificial  stereo  pictures  are  obtained  by  placing  a  set  of  optical  wedges  with 
different  wedge  angles  behind  the  Fourier  plane  diffraction  spots. 

The  following  real-time  experimental  implementation  of  halftone  screen  pro¬ 
cessing  was  performed  in  collaboration  with  H.  K.  Liu  of  JPL.  The  experimental 
configuration  is  shown  in  Figure  6.3.  The  halftone  images  were  written  by  imag¬ 
ing  the  input  transparency/contact  screen  sandwich  onto  the  MSLM  by  real-time 
hardclipped  thresholding.  Typical  operating  voltages  quoted  in  Chapter  5  were 
used,  and  the  threshold  was  adjusted  by  varying  and  ramping  downward 
firom  2.%kV  to  1.0  kV.  The  contact  screen  resolution  was  65  lines  fin,  or  equiv¬ 
alently,  20  lines /mm.  TMs  screen  resolution  was  therefore  around  the  resolution 
limit  of  the  MSLM  used.  A  x5  enlargement  of  the  oripnsJ  screen  was  made  by 
first  making  a  color  native  of  the  original,  and  then  making  a  black  and  white 
negative  by  contact  printing.  This  process  preserved  the  relative  gray  scale  profile 
of  the  contact  screen. 

The  real-time  halftone  procssnng  results  are  shown  in  Figure  6.4.  Figures  6.4a 
and  d  show  the  threshdded  images  of  an  input  gray  scale  transparency  consisting 
of  squared  areas  of  increasing  optical  density  for  2  different  thresholds;  while, 
b,  c  and  e,  f  show  the  corresponding  halftone  images  produced  by  sandwiching 
the  input  traaaparensy  first  with  the  enlarged  contact  screen,  and  the  original 
screen,  respectively.  Notice  the  spatial  frequency  modulation  according  to  gray 
level;  areas  of  higher  incident  intensity  have  lower  grating  fiequencies  than  those 
of  lower  incident  intensity.  Also,  areas  where  the  intensity  transmitted  by  the 
screen/transparency  sandwich  was  lower  than  the  threshold  are  unmodulated  and 
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Figure  6.3:  Optical  System  for  implementing  halftone  processing 
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remain  bright,  while  thoae  where  the  intensity  was  higher  than  the  threshold  are 
dark.  Figures  6.5a  and  b  show  the  thresholded  image  of  a  second  gray  scale 
transparency  of  a  woman’s  face  and  the  corresponding  halftone  inoage.  Write 
times  used  in  these  experiments  ranged  from  2.5  seconds  to  1  minute. 

Unfortunately  the  diffraction  grating  carrier  frequencies  which  resulted  from 
these  halftone  images  were  too  closely  spaced  to  be  filtered  successfully  with  the 
30*  focal  length  lenses  that  were  available.  Use  of  longer  focal  length  lenses 
(1.5  —  2.0  m)  in  the  coherent  optical  processor  will  enable  the  mentioned  non¬ 
linear  operation  to  be  realised. 
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(a) 


Figure  6.5:  More  real-time  halftone  screen  processing  results:  a)  ThreshoUled  gray 
scale  of  a  woman’s  fue  and  b)  corresponding  halftone  image 
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Chapter  7 
Conclusion 

7.1  Summary 

The  need  for  real-time,  versatile  spatial  light  modolators  to  replace  photographic 
film  has  long  been  recognised.  Such  high-resolution,  optically-addressed  elements, 
capable  of  exploiting  the  inherent  speed  and  parallel  processing  capability  opti¬ 
cal  processing,  are  essential  for  realising  futuristic  optical  computing  architectures. 
This  thesis  described  the  techniques  by  which  a  standard  MSLM  can  be  modi¬ 
fied  and  operated  to  achieve  high-resolution,  optically-addressed,  variable-gamma 
characteristics  applicable  to  a  wide  range  optical  informatirm  processing  appli¬ 
cations. 

The  first  such  technique  that  was  investigated,  entitiled  converting  the  stan¬ 
dard  MSLM  to  a  Fabry-Perot  version  MSLM.  This  required  depositing  dielectric 
mirrors  with  reflectivity  R  on  both  surfaces  of  the  electro-optic  crystal  plate. 
This  device  was  constructed  and  its  high  finesse  output  transmission  character¬ 
istics  (as  determined  by  R)  measured.  The  performance  of  the  F-P  MSLM  was 
evaluated  and  its  image  processing  limitations  analysed.  While  the  device  built 
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had  the  desired  high  finesse  behaviour,  this  high  finesse  capability  imposed  strict 
requirements  on  the  crystal  plane-parallelism  necessary  for  a  significant  area  of 
the  crystal  to  modulate  concurrently.  These  requirements  were  not  met  for  the 
mirror  refiectivity  R  that  was  used,  and  thus,  imapng  was  not  possible. 

The  next  technique  examined  was  the  operation  of  the  MSLM  in  a  closed  loop 
optical  feedback  configuration.  The  MSLM  behaviour  for  both  standard  and  F- 
P  versions  was  modelled  and  analysed  by  numerical  methods  and  was  found  to 
equilibrate  under  feedback.  It  is  possible  to  compensate  internal  phase  variations 
and  to  achieve  optically  bistable  images  using  this  configuration. 

Next,  the  desired  switching  characteristic  and  the  modes  of  operation  that 
could  be  used  to  convert  the  periodic  device  characteristic  were  described  and 
characterised.  These  modesi  included  the  electron/deposition  grid  stabilised  mode 
and  real-time  hardclipped  thresholding.  The  loss  of  proximity  focusing  and  re¬ 
sulting  image  degradation  in  the  electron  deposition  mode,  make  the  hardclipped 
thresholding  mode  the  preferred  mode  of  operation.  In  the  real-time  hardclipped 
thresholding  mode,  the  sensitivity  of  the  MSLM  was  found  to  increase  as  a  func¬ 
tion  of  write  intensity  /«  and  decrease  as  a  function  of  write  time  t«. 

Finally,  the  applications  of  this  high-resolution,  optically-addressed,  variable- 
gamma  spatial  light  modulator  in  optical  information  processing  were  ducussed 
in  general.  In  particular,  a  standard  MSLM  operated  in  the  hardclipped  thresh¬ 
olding  mode  was  used  to  demonstrate  real-time  halftone  screen  processing.  Un- 
fortunatdy,  the  spatial  resolution  oi  this  device  was  not  high  enough  to  achieve 
spatial  filtering  in  the  transform  plane  which  would  have  miabled  further  interest¬ 
ing  procesnng  operatimis. 

The  standard  and  the  F-P  MSLMs  were  found  to  have  quite  different  charac- 
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terutics.  The  high  fineeae  Fabry-Perot  device  ie  an  intrinsically  nonlinear,  high- 
gamma  modulator  and  can  be  applied  to  many  nonlinear  information  processing 
applications  in  its  linear  operating  modes.  On  the  other  hand,  the  standard 
MSLM  may  be  applied  to  linear  (low  gamma)  processing  in  its  linear  modes,  and 
nonlinear  (bistable)  procesring  in  its  thresholding  and  closed-loop  modes.  This 
makes  this  particular  modulator  appealing  since  its  versatility  permits  its  use  in 
many  facets  of  a  futuristic  optical  computer  in  addition  to  near-term  applications 
for  image  and  signal  processing.  Examples  of  present  day  implementations  in¬ 
clude  radar,  real-time  pattern  recognition,  real-time  holography  and  in  industrial 
inspection  systems. 

Both  the  standard  and  the  F-P  MSLM  can  be  operated  in  the  optical  feedback 
configuration  to  achieve  intonal  phase  compensation  and  optical  bistability.  This 
is  advantageous  since  it  allows  the  internal  device  phase  deviations  to  be  to  be 
compensated  and  optical  bistability  may  be  achieved  with  a  relatively  simple 
architecture. 

While  the  MSLM  has  now  been  studied  and  characterised  at  length,  there 
still  remain  improvenMnts  to  be  made.  The  following  section  describes  some 
suggestions  for  future  work  that  have  arisen  during  the  course  of  completing  this 
thesis. 


7.2  Future  Work 

The  research  described  in  this  thesis  is  the  most  recent  work  devoted  to  the  de¬ 
velopment  of  the  optically-addrsesed  MSLM,  here  at  M.I.T. .  In  the  early  years 
following  its  conception,  most  efforts  were  focused  on  investigating  the  fundamen¬ 
tal  operating  charcteristics  and  developing  the  optical  architecture  of  the  MSLM. 
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Later  studies  were  more  concerned  with  performance  evaluation  in  terms  of  speed 
and  resolution,  and  demonstration  of  optical  information  proceeang. 

This  thesis  has  attempted  to  study  the  operation  of  the  MSLM  in  a  methodical 
and  complete  manner.  Modification  of  the  standard  MSLM  to  a  F-P  device  was 
evaluated  and  several  operating  modes  (closed  and  open  loop)  were  characterised. 

Future  work  on  optically-addressed  MSLMs  should  include  demonstration  of 
MSLM  operation  in  the  closed-loop  feedback  configuration.  The  models  for  this 
architecture  have  been  calculated  and  discussed  herein.  Also,  the  MSLM  should 
be  used  to  implement  halftone  screen  processing  (as  described  in  Chapter  6), 
and  the  resultant  halftone  inures  iigected  into  a  coherent  optical  processor  with 
high  quality,  long  focal  length,  Fourier  transform  lenses.  Spatial  filtering  in  the 
Fourier  plane  can  then  be  employed  to  achieve  many  interesting  image  processing 
operations. 

The  Fabry-Perot  MSLM  needs  to  be  developed  further.  Such  a  device  with  a 
visible  photocathode  is  desirable  in  many  nonlinear  processing  applications.  The 
present  polishing  technology  limits  the  achievable  crystal  face  plane-parallelism, 
which  in  tiim  imposes  a  limitation  on  the  maximum  useful  finesse  of  the  F-P 
(related  to  mirror  reflectivity  R).  This  limitation  on  the  etalon  plane-parallelism 
may  be  alleviated  by  eliminating  the  use  of  a  polished  thin  crystal  piate  and 
developing  an  MSLM  which  utilises  thin  film  modulation  materials  instead.  Such 
materials  could  be  deposited  uniformly  onto  a  A/20  optical  flat  by  evaporation 
or  some  other  technique,  and  would  have  substantially  better  plane-parallelism. 
These  materials  would  also  eliminate  the  need  to  be  able  to  polish  very  thin  flat 
cystals  to  achieve  higher  resolution  devices,  and  might  also  reduce  the  cracking  of 
the  thin  crystals  due  to  strain  and  high  electrostatic  fields. 
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Further  studies  of  the  limitations  of  presently  available  MSLMs  are  also  nec¬ 
essary.  These  include  investigation  of  the  MTF,  speed,  usable  finesse,  maximum 
operating  voltages  and  minimum  thickness  of  the  crystal  plate. 
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Appendix  A 

Fabry-Perot  MSLM  Assembly 

Considerable  effort  was  devoted  to  designing  a  novel  scheme  for  assembling  a 
vacuum-demountable  MSLM.  The  design  which  was  implemented  addressed  the 
following  problems  encountered  in  previous  designs: 

1.  the  crystal  crystal  was  epoxied  and  irretrievable 

2.  the  glass  substrate  exerted  pressure  on  the  MCP  through  the  grid 

3.  parallelism  of  components  and  even  pressure  were  governed  by  the  same 
teflon  bolts  which  held  the  device  in  place 

4.  changing  device  components  required  disassembly  of  the  entire  device 

5.  the  device  was  assembled  directly  onto  the  6*  vacuum  flange  for  the  vacuum 
cell. 

The  architecture  which  was  developed  for  the  construction  of  the  Fabry-Perot 
MSLM  was  also  utilised  by  Phillip  Mak  to  build  a  electron-beam  MSLM  and  is 
very  compact  in  physical  dimensions  [19], 
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Component 

Dimensions 

inches 

mm 

MCP 

Active  area  diameter 

1.000 

25.4 

Outer  edge  diameter 

1.287 

32.7 

Thickness 

0.017 

0.432 

Crystal 

Outer  edge  diameter 

1.004 

25.5 

Thickness 

0.012 

0.300 

Grid 

Inner  ring  diameter 

0.700 

17.8 

Outer  ring  diameter 

0.876 

22.3 

Ring  thickness 

0.055 

1.31 

Table  A.l:  Relevant  dimensions  of  the  Fabry-Perot  MSLM  components 

Figure  A.l  contains  the  individual  flange  specifications.  The  dimensions  of  the 
flanges  were  carefully  chosen  for  use  with  the  components  of  dimensions  shown 
in  Table  A.l.  Note  the  larger  #6  nut  clearance  holes  in  the  MCP  and  crystal 
flanges.  Basically,  the  recessed  lip  in  the  center  of  the  flanges  allow  the  MCP,  grid 
and  crystal  to  be  held  in  place  without  any  epoxy,  and  the  physical  dimensions 
permit  minimal  pressure  exertion  on  each  component. 

The  metal  flanges  were  manufactured  using  0.0625*  (1.59mm)  thick,  type  304 
stainless  steel.  The  MCP  output  electrode  is  made  of  0.002*  (0.051mm)  nickel  foil 
and  the  bolt  holes  machined  to  specifications  between  two  0.25”  (6.35mm)  slabs 
of  aluminum  to  preserve  its  flatness.  The  insulating  layers  are  made  of  0.005* 
(0.127mm)  teflon  sheet. 

This  design  allowed  the  device  to  be  assembled  in  situ  and  then  mounted 
onto  the  6.0*  (152mm)  vacuum  flange  using  the  center  B,  #6  clearance  holes, 
and  teflon  bolts  (see  Figure  A.l).  These  bolts  were  only  tightened  as  much  as 
necessary  to  keep  the  device  in  place  and  exert  no  pressure  on  the  components. 
The  amount  of  time  that  the  cell  needed  to  be  off-vacuum  was  thus  minimized. 
The  center  grid  flai^e  served  as  an  anchor  for  the  MCP  and  the  crystal/grid 
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(b) 


2.S0QP  o.d. 

2.050*  bolt  circle 


» - 1.300* - *  0.0625* 


K-O.«00r  .0.0625* 


0.0515*  If  0.701/ 


Figure  A.l:  Febry-Perot  flange  speciflcations:  a)  MCP,  b)  Grid  and  c)  Crystal 
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sections  independently;  thus,  the  MCP  could  be  changed  without  affecting  the 
crystal  or  grid,  and  vice  versa.  This  independence  of  components  is  enabled  by 
the  fact  that  the  MCP  mounting  hardware  utilised  the  C  holes  (larger  clearance 
size  hole  in  the  crystal  flange),  while  the  crystal/grid  hardware  utilised  the  A 
holes  (larger  clearance  size  hole  in  the  MCP  flange).  Corresponding  holes  are  120” 
apart  on  the  bolt  circle.  None  of  the  MSLM  components  were  epoxied  and  could 
be  removed  and  replaced.  This  feature  is  especially  convenient  for  interchanging 
high  and  low  strip  current  MCPs,  as  well  as,  Fabry-Perot  and  standard  crystals. 
The  MCP  section  can  also  be  modifled  to  accommodate  a  two  MCP  configuration 
by  using  the  appropriate  flanges  with  the  correct  bolt  configuration. 

The  following  procedure  was  used  to  build  the  Fabry-Perot  device.  All  hard¬ 
ware  and  tools  were  degreased  using  reagent  trichloroethane  aa  necessary,  and 
washed  with  reagent  grade  acetone  and  methyl.  A  final  wash  in  semiconductor 
grade  acetone  completed  the  cleaning  cycle. 

Assembly  steps  are  as  follows; 

1.  Crystal/grid  asMtmbly 

Determine  crystal  conducting  surface 

Place  crystal  in  recess  of  crystal  flange,  electrode  side  down 

Insert  #6  —  32  nylon  screws  in  the  three  A  holes,  posts  up 

Place  one  layer  of  teflon  sheet  on  top  of  crystal  flange 

Center  grid  on  teflon  layer 

Wrap  grid  wire  around  screw  post 

Position  grid  flange  with  grid  in  recess 

Tighten  bolts 
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2.  MCP  assembly 

Insert  #6  —  32  nylon  screws  in  the  three  C  holes,  posts  up 

Wrap  MCP  output  wire  uound  screw  post 

Center  Nickel  electrode,  attach  wire 

Place  two  layers  of  teflon  sheet  on  Nickel  electrode 

Position  MCP  in  center  of  teflon 

Position  MCP  input  flange  with  MCP  in  recess 

Tighten  bolts 

3.  Mount  device  on  6"  flange 

Mount  device  on  vacuum  flange  using  B  holes 


Overall,  this  design  was  quite  successful.  The  independent  nature  of  the  MCP 
and  the  crystal/ grid  sections  was  actually  tested  when  the  the  original  grid  had  to 
be  replaced.  The  only  disadvantages  were  some  movement  of  the  crystals  under 
high  electric  field  and  the  active  area  of  the  crystal  being  reduced  from  1.0*  to 
0.7*  (that  is,  from  25mm  to  18mm). 


Appendix  B 

Anomalous  Observations 

While  conducting  the  experimental  work  for  this  thesis,  a  number  of  unusual  ober- 
vations  were  made  about  the  MSLMs.  These  anomalous  characteristics  have  been 
categorised  with  reference  to  the  particular  device  with  which  it  was  observed. 
A  reasonable  explanation  is  given  wherever  possible;  however,  in  the  case  of  the 
Hamamatsu  device,  much  of  the  necessary  information  required  to  form  a  con* 
elusive  answer  was  unknown.  Therefore,  the  explanations  given  were  formulated 
partly  from  the  limited  information  aviulable  and  partly  from  some  speculation 
on  the  author’s  part.  These  observations  are  included  in  the  hope  that  they  prove 
useful  to  other  users  of  the  MSLM. 

B.l  Fabry-Perot  MSLM 

B.l.l  Marked  Decrease  in  Device  Speed 

Slowing  down  of  the  device  after  the  grid  voHage  was  aeeidentally  raised  to  +2.5  kV: 

The  high  voltage  resulted  in  a  stretching  of  the  center  of  the  grid,  so  that, 
although  there  was  no  actual  short  to  any  other  component,  the  transmission  of 
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the  grid  was  severely  impaired  by  its  flapping  movement  during  operation,  and 
resulted  in  less  electrons  reaching  the  crystal. 

B.1.2  Bias  Voltage  Drifting 

Rapid  drifting  of  the  bias  voltage  during  operation  (deereaeee  about  600  V  m  45 
minutes/' 

The  high  strip  current  MCP  was  heating  up  the  crystal  faster  than  heat  could 
be  dissipated  (slow  in  vacuum),  resulting  in  a  rise  in  the  net  crystal  temperatiure. 
Also,  heat  is  generated  from  the  stopping  power  of  the  crystal;  that  is,  kinetic 
energy  of  the  electrons  is  converted  into  heat  ~  eV,  where  V  =  |Vt  +  V^^^  +  V^j 
(Vfe  is  the  MCP  ejection  energy  ~  lOV,  and  V^^  and  V,  are  the  grid  and  gap  volt¬ 
ages,  respectively).  The  electo-optic  coefficients  of  the  LiNbOs  are  temperature 
dependent  and  will  change  slightly,  causing  the  bias  voltage  to  shift. 

B«2  Hamamatsu  Standard  MSLM 

B.2.1  Unusually  high  V^r 

The  reflex  halfwave  ooHage  V,jt  was  meosursd  around  4.5  kV: 

Possible  error  in  the  crystal  cut;  large  voltage  drop  across  the  dielectric  mirror; 
inconclusive. 

B.2.2  Nonuniform  charge  build-up 

Charged  tended  to  be  more  attroeted  to  the  edges  of  the  crystal: 

Possibly  related  to  the  internal  device  architecture;  inconclusive. 
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B.2.3  Dark  Ring 

A  dark  ring  was  observed  on  the  crystal  output  when  read  out  (see  Figure  B.l): 

The  obeerved  ring  always  remained  dark  and  did  not  modulate  when  charge 
was  added  to  the  crystal  surface.  This  ring  has  the  appearance  of  an  interference 
fringe  and  is  perhaps  the  result  of  a  reflection  from  the  glass  sulMtrate  interfering 
with  the  image. 

B.2.4  Ghost  Image 

A  ghost  image  of  the  resolution  chart  that  had  bun  previously  stored  m  the  device, 
was  found  to  remain  embedded  in  the  dielutrie  mirror  (Figure  B.2)  even  after  the 
crystal  was  erased: 

This  ghost  image  was  found  to  result  after  a  few  hours  of  image  storage,  and  did 
not  disappear  for  a  couple  of  weeks.  Device  usage  seemed  to  accelerate  the  ghost 
image  removal.  The  ghost  modulated  when  the  crystal  voltage  was  changed  with 
uniform  incident  intentnty;  and  was  superimposed  in  the  backgroimd  whenever 
any  images  were  written  onto  the  device. 

This  phenomenon  probably  stems  in  the  materials  used  for  fabricating  the 
dielectric  mirror.  The  storage  time  of  the  dielectric  mirror  seems  too  long  and 
charge  is  trapped  in  its  surface.  This  trapping  phenomenon  may  also  result  from 
the  presence  of  an  additional  secondary  electron  emission  material  evaporated 
on  top  of  the  dielectric  mirror:  charge  may  penetrate  this  r^terial  and  become 
trapped  by  the  dielectric  mirror. 

B.2.5  Image  Curvature 

A  slight  curvature  of  the  image  recorded  on  the  MSLM  was  observed  m  the  output 
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Figure  B.l:  Dark  ring 


Figure  B.2:  Ghost  image 
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plane: 

Figure  B.3a  is  a  photograph  of  the  focused  input  image  of  the  Air  Force  res¬ 
olution  chart  that  was  incident  on  the  photocathode;  notice  that  there  was  no 
distortion.  Figure  B.3b  is  a  photograph  of  the  image  produced  when  the  resolu¬ 
tion  chart  was  placed  against  the  output  window  of  the  MSLM  (the  interference 
fringes  are  the  result  of  reflections  from  the  front  and  back  faces  of  the  quartz 
plate);  notice  this  image  is  also  undistorted.  Since  the  curvature  was  not  intro¬ 
duced  by  either  the  write  or  the  readout  path,  it  must  have  been  introduced  by  the 
device  (see  Figure  B.3c).  Upon  closer  inspection,  the  photocathode  was  found  to 
be  slightly  convex,  which  would  account  for  the  image  curvature.  This  effect  can 
be  corrected  by  using  a  fiberoptic  faceplate  in  front  of  the  photocathode.  The  im¬ 
age  is  then  focused  on  the  input  planar  face  and  transferred  to  the  photocathode. 


B.2.6  Crystal  Cracking 

Cracking  of  the  crystal  along  the  z-axis: 

This  was  perhaps  the  most  puzzling  observation  of  all.  It  was  found  that  there 
were  two  distinct  cracking  phenomenon;  one  seemed  to  be  reversible,  while  the 
other  was  permanent. 

Figure  B.4a  is  a  photograph  of  the  output  image  of  the  Hamamatsu  MSLM  in 
the  condition  in  which  it  was  received  at  M.I.T.  The  conditions  under  which  this 
initial  crack  was  formed  are  unknown. 

However,  during  subsequent  use,  the  following  cracking  of  the  crystal  was 
observed: 

•  Positive  Charge  Deposition 


183 


APPENDIX  B.  ANOMALOUS  OBSERVATIONS 


112 


Figure  B.3:  Image  curvature:  Resolution  chart  a)  imaged  by  write  optics,  b)  im¬ 
aged  by  readout  optics,  and  c)  stored  and  read  out  of  device 


184 


APPENDIX  B.  ANOMALOUS  OBSERVATIONS 


113 


The  following  operations  were  performed  with  uniform  incident  intensity  in 
all  cases. 

1.  V*  was  slowly  decreased  from  0  to  —1875  V  (2875  V  of  positive  charge 
on  the  mirror);  and  then  slowly  returned  to  0  V.  The  resulting  output 
is  shown  in  Figttre  B.4b,  these  observed  lines  are  2dl  parallel  to  the 
crystal  axis. 

2.  The  crystal  voltage  was  increased  slowly  from  0  to  +2840  V  and  then 
reduced  again  to  OK.  The  severity  of  the  observed  lines  were  found  to 
have  decreased  (see  Figure  B.4c). 

3.  The  device  was  shut  down  and  the  crystal  photographed  2.5  hours  later 
(see  Figure  B.4d). 

Notice  that  the  lines  seem  to  slowly  disappear  with  time.  This  recovery 
is  accelerated  by  depositing  and  removing  negative  charge.  The  above  phe¬ 
nomenon  was  repeatable.  If  the  crystal  voltage  was  lowered  to  only  -1200  K, 
the  lines  also  appeared,  but  were  not  as  severe. 

•  Negative  Charge  Deposition 

Agaun,  the  following  occured  with  uniform  incident  intensity  in  all  cases. 

1.  Vt  was  accidentally  raised  to  about  +3300  V  (2300  V  of  negative  charge] , 
then  lowered  to  OK.  Notice,  the  single  crack  which  appeared  across  the 
crystal,  parallel  to  the  z-axis  and  the  initial  crack  (see  Figure  B.4e). 
The  faint  lines  in  the  background  resulted  from  positive  charge  depo¬ 
sition  and  were  in  the  process  of  fading  away.  This  new  crack  was 
found  to  modulate  more  slowly  and  out  of  phase  with  the  reminder  of 
the  crystal.  Similar  behaviour  was  also  observed  for  the  original  crack. 
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Figure  B.4:  Cracking  phenomenon:  a)  Original  crack 

Positive  charge  deposition:  b)  V»,  0  to  —1875  to  0  volts,  c)  0  to  +2840  to  0  volts 
and  d)  after  2.5  hours 

Negative  charge  deposition:  e)  V*  accidentally  raised  to  +3300  V 
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This  crack  did  not  fade  or  recover  as  in  the  previous  case,  but  instead, 
remained  on  the  crystal. 

2.  The  voltage  was  raised  to  +3050  V  a  few  months  later,  and  yet  a  third 
line  appeared  with  the  same  characteristics. 

The  above  cracks  were  permanent  and  severe.  They  were  parallel  to  the  crystal 
axis  and  modulated  more  slowly  than  the  background.  These  lines  could  also  be 
observed  on  the  crystal  surface  by  looking  directly  into  the  output  window  of  the 
device. 

The  possible  sources  of  this  phenomenon  are  the  dielectric  mirror  or  the  crystal. 
However,  the  parallelism  of  these  cracks  to  the  crystal  axis  indicates  that  the 
explanation  lies  with  the  crystal.  In  addition,  the  dielectric  nurror  is  deposited 
without  any  uniform  orientation  and  consists  of  alternating  layers  of  two  different 
materials;  thus,  eliminating  any  reason  for  the  uniformly  formed  lines. 

Since  these  effects  have  not  been  observed  in  vacuum  demountable  devices 
with  300  —  330  ftm  crystals,  the  cracking  is  probably  related  to  the  fact  that  the 
crystal  thickness  has  been  reduced  to  50  nm  for  these  sealed-off  devices. 

Without  further,  posubly  destructive  experimentation,  the  following  explana¬ 
tion  seems  to  be  the  most  feasible.  Consider  the  50  nm  thick  55” -cut  LiNbOs 
crystal,  epoxied  to  a  f^ass  substrate  in  Figure  B.5a.  If  positive  charge  is  deposited 
on  the  dielectric  mirror  the  resulting  voltage  V,  across  the  crystal  produces  an 
electric  field  across  the  crystal  (from  right  to  left).  This  field  tries  to  rotate  the 
z-axis  of  the  crystal,  so  that  it  is  parallel  to  the  field;  this  would  result  in  poling  of 
the  crystal  (Figure  B.5b).  Conversely,  if  negative  charge  is  deposited,  the  resulting 
electric  field  tends  to  rotate  the  z-axis  in  the  opposite  direction  (Figure  B.5c). 

Sometime  in  its  manufacture,  the  LiNbOj  crystal  was  grown  and  its  individual 
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Ftgttn  B.8:  Cliarf*>indiiic«d  pding  «xpUution  of  obUquo<ut  LiNbOs:  o)  Crys- 
Ul  oriontation  in  b)  poiitiTi  dinrft  doporition  (oloctnm  romoval),  nnd 

c)  nognthro  chnrgo  dtpodUon  (oloctroo  dtporition) 
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domains  rotated  so  that  their  s-axes  were  all  parallel.  The  electric  fields  that  are 
created  by  deposited  positive  and  negative  charge  attempt  to  rotate  the  s-axes 
of  these  individual  domains;  that  is,  pole  the  crystal  in  the  transverse  direction. 
The  forces  necessary  for  a  thiek  crystal  are  much  greater  than  those  for  a  50  ftm 
crystal. 

Notice  that  with  positive  charge  deposition,  the  tendency  is  for  the  charge- 
induced  electric  field  to  realign  the  s-axis  by  rotating  it  55”  and  thus,  is  an  easier 
operation  than  when  negative  charge  is  deposited  and  the  s-axis  wants  to  rotate 
125”.  It  seems  reasonable  that  the  positive  charge  case  is  somewhat  reversible, 
since  once  the  charge  is  removed  the  domain  will  tend  to  realign  itself.  However, 
with  negative  charge  deposition,  the  rotation  of  a  domain  may  result  in  cracks 
and  permanent  phyncal  damage  in  the  crystal  and  is  thus  irreversible;  but  since  a 
larger  angle  of  rotation  is  required,  fewer  domuns  are  affected.  Domains  which  do 
rotate  have  s-axes  lined  up  with  the  induced  field  and  have  the  halfwave  voltage 
corresponding  to  s-cut  LiNbOs  (about  3100  V).  Thus  the  modulation  would  be 
slower  than  the  background  55*-cut  crystal  (V,ji  =:  1250 K). 

While  this  explanation  is  supported  by  the  observations  described  above,  fur¬ 
ther  stu<Hes  of  the  effects  of  strong  dectric  fields  on  (hm  polished  electro-optic 
crystals  need  to  be  conducted. 
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I.  INTRODUCTION 

Th»r«  haa  baan  a  graat  daal  of  activity  in  tha  davalopmant 
of  compact  raal-tima  coharant  optical  corral ator a  for  uaa  in  a 
variaty  of  pattarn  racognition  applicationa  (1-3).  Tha  moat 
critical  componant  in  many  corralator  daaigna  ia  a  liquid  cryatal 
light  valva  (LCLV)  Mhich  allowa  an  incoharant  imput  imaga  from  an 
optical  viaMing  ayatam  to  ba  convartad  into  a  coharant  imaga  for 
aubaaquant  analyaia  by  tha  optical  corralator. 

Tha  oparation  of  thaaa  davicaa  dapanda  on  tha  alactrlcal 
control  of  tha  biraf ringanca  of  a  thin  liquid  cryatal  layar.  Tha 
davicaa  which  wa  hava  atudiad  oparata  in  a  raflaction  moda  in 
which  tha  linaarly  polarisad  raadout  light  antara  from  ona  aida, 
paaaaa  through  tha  liquid  cryatal,  raflacta  off  a  mirror,  and 
raturns.  Tha  biraf ringanca  inducaa  a  componant  of  polarization 
parpandicular  to  tha  incidant  raadout  polarization.  Thia 
parpandicular  polarization  ia  tha  output  aignal  of  tha  LCLV.  Tha 
dagraa  of  biraf ringanca  ia  control lad  by  having  a  writing  baam 
incidant  on  a  photoconductor  layar.  Aa  tha  intanaity  of  tha 
writing  light  incraasaa,  tha  raaiatanca  of  tha  photoconduct iva 
layar  dacraaaaa,  cauaing  a  graatar  fraction  of  tha  appliad 
voltaga  to  appaar  acroaa  tha  liquid  cryatal  layar. 

Currantly,  thara  ara  two  manuf acturara  of  thaaa  liquid 
cryatal  light  valvaai  Hughaa  Aircraft  and  Loral  EOS.  Tha  Hughaa 
davica  waa  introducad  in  tha  1970' a  (4,5)  and  haa  baan  in 
ccNnmarcial  production  for  a  numbar  of  yaara.  Our  taata  wara 
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p»r4orm«d  on  •  unit  with  morial  number  1118S  obtained  from  Hughe* 
as  a  donation  to  our  educational  program.  Although  the  Loral 
device  was  also  introduced  in  the  1970' s,  it  is  still  in 
development  stages.  The  one  we  are  using  has  the  serial  number 
SB  and  is  on  loan  from  Loral  EOS.  This  report  summarizes  those 
results. 

The  next  section  gives  a  general  discussion  of  the  operation 
of  these  devices  and  analyzes  their  common  points  as  well  as 
their  differences.  Then,  the  next  two  sections  discuss  the 
experimental  results  for  the  two  devices.  Finally,  we  summarize 
our  findings  and  compare  the  characteristics  of  the  two  devices. 
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II.  OPERATING  PRINCIPLES  OF  LIQUID  CRYSTAL  LIGHT  VALVES 

A  drawing  showing  th*  construction  oi  th*  Hughas  liquid 
crystal  light  valv*  is  shown  (4)  in  Figur*  1.  Th*  Loral  d*vic*, 
although  vary  similar,  has  savaral  important  di 'f 'f arancas  which 
will  ba  discussad  latar. 

Tha  Hughas  davic*  consists  q4  4  major  componants:  a  Cadmium 
Sul 'fid*  (CdS)  photoconductor,  a  Cadmium  Tal  lurid*  (CdTa)  light 
blocking  layar,  a  dial metric  mirror,  and  a  namatic  liquid  crystal 
with  an  AC  bias  voltag*  placad  across  tha  antira  packaga. 

Normally,  tha  majority  of  tha  voltaga  appaars  across  tha 
photoconduct iva  layar  whan  tha  davica  is  in  tha  off  stata  (no 
incidant  writing  light).  In  practica,  thara  is  soma  laakaga  and 
a  small  fraction  of  tha  voltaga  doas  appaar  across  tha  liquid 
crystal  layar.  Nota  that  tha  AC  bias  voltaga  producas  an  avaraga 
DC  bias  across  tha  liquid  crystal  sines  tha  photoconductor  layar 
and  tha  light  blocking  layar  combina  to  form  a  dioda  junction. 

Tha  usa  of  AC  also  anhancas  tha  davica  lifatima. 

Mhan  light  is  incidant  on  tha  photoconductor,  tha  affactiva 
rasistanca  of  tha  photoeonductor  dacraasas  causing  tha  fraction 
of  tha  bias  voltaga  appaar ing  across  it  to  dacraasa.  This 
rasults  in  a  graatar  fraction  of  tha  bias  voltaga  appaar ing 
across  tha  liquid  crystal  layar.  This  light  baam  which  is 
incidant  on  tha  photoconducti va  layar  is  rsfarrad  to  as  tha 
WRITING  baam.  Obviously  tha  wavalangth  of  tha  writing  baam 
should  ba  chosan  to  affact  tha  maKimum  changa  in  tha 
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Figura  1  •>  SehMatic  dr«Mlng  of  tha  Hughaa  liquid  crystal  light 
valva.  <FroA  Kaf.  4) 
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photoconducti V*  lay*r  ‘for  a  minimum  writing  int*nsity  and  d*p*nds 
on  th*  particular  photocoiducti v*  material  us*d.  Th* 
photoconducti V*  lay*r  in  th*  Hugh**  d*vic*  is  CdS  whil* 

ASzS*?  is  us*d  in  th*  Loral  d*vic*.  Th*r*for*  w*  would 
*xp*ct  diff*r*nt  wav*l*ngth  s*nsitiviti*s  for  th*  two  d*vices. 

Th*  liquid  crystal  is  a  twistsd  nsmatic  typ*  whos*  molscul** 
hav*  a  long  cigar  shap*.  In  th*  abs*nce  of  an  appli*d  el*ctrlc 
fi*ld,  th*  axis  of  symmstry  of  th*  mol*cul*s  is  ori*nt*d  parallsl 
to  th*  antranc*  fac*  of  th*  liquid  crystal.  Th*  symm*try  ax**  of 
th*  mol*cul*s  und*rgo  a  ralativ*  twist  wh*n  followed  through  th* 
liquid  crystal  lay*r  as  shown  (7)  in  Figur*  2a.  Th*  oriantation 
of  th*  molaculas  at  aithar  and  is  datarminad  by  "twining"  th* 
substrata  boundarias.  This  t*rm  maans  that  groovas  ar*  millsd 
into  th*  surfac*  layars  which  fore*  th*  molaculas  to  oriant  in  a 
dasirad  diraction  at  th*  two  surfacas.  In  th*  Hugh**  davica,  tha 
molaculas  twist  through  a  45  dagraa  angl*  whil*  th*  Loral  davica 
usas  a  90  dagraa  twist. 

As  tha  voltag*  across  tha  liquid  crystal  layar  incraasas, 
both  tha  twist  and  tilt  of  tha  liquid  crystal  molaculas  changa  as 
shown  in  Figura  2b  and  2c  which  affacts  tha  biraf ringanca  of  th* 
liquid  crystal  layar.  Figur*  3  shows  graphical  plots  for  both 
tha  twist  and  tilt  as  tha  alactric  fiald  changas  (4). 

With  no  voltag*  appliad  to  th*  davica,  th*  twist  incraasas 
uniformly  across  tha  liquid  crystal  thlcknass.  Howavar,  as  tha 
voltag*  incraasas,  tha  liquid  crystal  molaculas  untwist  and 
bacoma  alignad  with  th*  prafarrad  diractions  at  th*  raspactiva 
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Flgur*  2  ->  OrsMlng  showing  ths  orlsntstion  of  ths  liquiS  crystal 
molsculss  in  a  90  dsgrss  twist  dsvics.  Flgurs  2a  shows  ths 
molacular  orisntatlon  with  no  applisd  ft old.  Plguro  2b  shows  ths 
s-f-focts  of  a  modorato  fiold  whilo  Figurs  2c  shows  th*  offsets  of 
a  largo  oioctric  fisld.  (from  Rof  7). 
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UMNO:  VOt.tAMQPf 

— —  VOkTAMO* 
— —  WIM. 


Figura  3  -  Calculatad  valuas  shOMing  molacular  orlantation  as  a 
unction  o4  pool t ion  aerooo  tbo  liquid  crystal  coll  for  a  4S 
dogroo  twist  dovico.  Figure  3a  shows  tho  twist  while  Figure  3b 
shows  the  tilt.  (Free  Ref.  4>. 
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•dg*s  a*  shown  in  Figur*  3 

Th*  tilt  is  initially  zmra  and  th*  long  cigar  shapad 
mol*cul*s  ar*  allgnod  as  shown  in  Figur*  2a.  How*v*r,  wh*n  th* 
*l*ctric  fiald  is  Incrsassd,  th*  mol*cul*s  gradually  tilt  as 
shown  in  Figur *s  2b  and  2c  with  th*  long  axis  bscoming  parallsl 
to  th*  appliad  fiald  and  hanc*  parallal  to  th*  diraction  of 
propagation  of  th*  light  incidant  on  th*  liquid  crystal.  This 
incident  light  is  callad  th*  READING  b*am  and  is  initially 
polar! z*d  parallal  to  th*  pr*f*rr*d  oriantation  diraction  of  th* 
liquid  crystal  molaculas  on  th*  input  sid*. 

Not*  that  th*  voltag*  on  th*  liquid  crystal  layar  can  b* 
Incraasad  by  oithar  ineraasing  th*  total  bias  voltag*  across  th* 
d*vic*  or  by  having  th*  writing  b*am  d*cr*as*  th*  rssistanc*  of 
th*  photoconduct iv*  layar. 

If  th«r*  is  no  bias  voltag*  across  th*  liquid  crystal  layar, 
th*  plan*  of  polarization  of  th*  roading  baam  rotatas  by 
following  th*  ralativ*  twist  of  th*  major  ax as  of  th*  molaculas. 
Th*  light  than  r*fl*cts  off  th*  dialactric  blocking  layar  and  th* 
polarization  untwists  as  it  rsturns.  Tharafora,  th*  polarization 
of  ths  rsflsetsd  bsam  is  ssactly  ths  sams  as  ths  incidant  baam. 

Howsvsr,  whsn  an  slsctric  fisld  is  placad  on  th*  liquid 
crystal  rssulting  in  ths  configuration  shown  in  Figur*  2b,  th* 
polarization  stat*  of  ths  incidant  rsading  bsam  romains  unchangod 
through  ths  first  portion  of  ths  crystal  sines  th*  twist  has  bsan 
ramevad.  Ths  symmatry  axas  of  ths  liquid  crystal  molaculas  in 
tha  sscond  half  of  tha  liquid  crystal  layar  ara  now  alignad  at  45 
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dagraas  to  tha  initial  polarization  diractlon  (in  tha  caaa  of  tha 
Hughas  davica) .  Tharafora,  tha  aacond  half  layar  bacomaa 
birafringant  and  producaa  an  orthogonal  polarization  atata  aa  tha 
baam  paaaaa  through  tha  liquid  cryatal  layar,  raflacta,  and 
raturna.  Thia  polarization  atata  can  ba  aaparatad  by  uaing  a 
polarization  aplitting  baamapl i ttar. 

Tha  ralativa  biraf ringanca  dapanda  on  tha  propagation 
diraction  of  tha  incidant  baam.  If  it  ia  not  orthogonal  to  tha 
plana  of  tha  davica,  tha  affactiva  thicknaaa  of  tha  liquid 
cryatal  layar  will  dapand  on  tha  incidant  angla  with  diffarant 
birafringant  affacta  for  diffarant  anglaa.  For  thia  raaaon, 
normal  incidanca  ia  racommandad. 

Aa  tha  voltaga  incraaaaa  furthar  raaulting  in  tha 
configuration  ahown  in  Figura  2e,  tha  major  axaa  of  tha  liquid 
cryatal  molaculaa  bacoma  alignad  to  tha  propagation  diractlon. 
Thua  tha  liquid  cryatal  layar  ia  no  longar  birafringant  and  tha 
polarization  atata  of  tha  raflactad  light  ia  unchangad. 

Tharafora,  tha  parcantaga  of  tha  orthogonal  polarization 
davalopad  by  tha  davica  ia  initially  zaro,  incraaaaa  to  aoma 
maxi mum,  and  than  dacraaaaa  again  aa  tha  voltaga  acroaa  tha 
liquid  cryatal  layar  incraaaaa  aa  ahown  in  Figura  4  (4). 

Tha  oparation  of  a  davica  having  a  90  dagraa  twiat  ia 
aimilar  with  an  important  diffaranca.  Undar  tha  appliad  alactric 
fiald,  tha  twiat  of  tha  molaculaa  again  aligna  to  tha 
prafarantial  diractiona  at  aithar  and  aa  ahown  in  Figuraa  2  and 
3.  Howavar  in  thia  caaa,  tha  ralativa  twiat  in  tha  ON  atata  ia 
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Figur*  4  -  iKpari Mental  curve*  ehowing  the  relative  transmlaaion 
of  liquid  crystal  devices  Mith  a  45  degree  teist  and  a  90  degree 
tMist.  (Free  Ref.  4) 
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90  d*gr*«s.  Thara-for*,  th*  polarization  stata  of  tha  raading 
baaa  ramaina  unchangad  through  tha  firat  half  of  tha  liquid 
cryatal  layar  ainca  tha  twiat  haa  baan  ramovad  aa  bafora. 

Howavar,  tha  aymmatry  a>:aa  of  tha  molaculaa  in  tha  aacond  half  of 
tha  liquid  cryatal  layar  ara  now  orthogonal  to  thoaa  in  tha  firat 
half.  Tharafora,  no  polarization  atata  would  ba  davalopad 
parpandicular  to  tha  initial  polarization  diraction  ainca  tha 
initial  atata  of  polarization  would  lia  along  tha  minor  Indax 
allipaoid  axia  of  tha  liquid  cryatal  layara  in  tha  aacond  half  of 
tha  davica.  Tha  parcantag*  of  tha  orthogonal  polzarization  atata 
which  ia  davalopad  ahould  tharafora  ba  laaa,  and  would  only 
raault  from  tha  variation  in  twiat  at  tha  cantar  of  tha  liquid 
cryatal  layar  aa  ahown  in  Figuraa  2  and  3.  Figura  4  (takan  from 
Fafaranca  4)  ahowa  tha  ralativa  tranamiaaion  of  liquid  cryatal 
davicaa  having  4S  and  90  dagraa  twiat a  damonatrating  tha 
aupariority  of  tha  49  dagraa  daaign.  Howavar,  our  axparimantal 
raaulta  ahew  tha  raflaetivity  of  tha  Loral  davica  to  ba  roughly 
comparabla  to  that  of  tha  Hughaa  davica  in  apita  of  tha  fact  that 
tha  Loral  davica  ia  raportad  to  hava  a  90  dagraa  twiat.  Wa  do 
not  undaratand  thia  dlacrapancy. 

Aa  mantionad  abova,  a  graatar  fraction  of  tha  raading  baam 
will  ba  raflaetad  into  tha  oppoaita  polarization  atata  aa  tha 
birafringanca  of  tha  liquid  cryatal  layar  incraaaaa.  Obvioualy 
in  tha  optimum  caaa,  lOOX  of  tha  raading  baam  would  bo  convortad 
into  tha  orthogonal  polarization  atata.  Zn  our  axpari manta,  wa 
maaaurad  tha  abaoluta  davica  raflaetivity. 


209 


Pag*  14 


An  important  diffmrmncm  in  operating  param*t*rB  for  th*  two 
davic**  is  in  th*  AC  'fr*qu*ncy  of  th*  bias  voltag*  which  must  b* 
chossn  to  maKimiz*  th*  impsdanc*  match  b*tw**n  th*  liquid  crystal 
and  th*  photoconductor /photocapacitor  substrat*  (6).  Th* 
r*comm*nd*d  bias  frsqusncy  for  th*  Hugh**  dsvic*  is  10  kHz. 
How*v*r,  Loral  sp*cifi*s  bias  fr*qu*nci*s  in  th*  10  -  50  Hz  rang* 

This  *Ktr*m*ly  low  valu*  for  th*  Loral  op*rating  fr*qu*ncy 
rais*d  som*  concarns  about  th*  offsets  of  this  AC  bias  on  th* 
rospons*  tim*  of  th*  d*vic*.  Th*  r*spons*  tim*  of  th*  d*vic* 
d*p*ndB  on  th*  rospons*  tim*s  of  both  th*  photoconductor  and 
liquid  crystal  layors.  Usually,  th*  latt*r  dominat**  and  is 
d*p*nd*nt  on  th*  r*ori*ntation  tim*  r*quir*d  for  th*  liquid 
crystal  mol*cul*s  und*r  th*  mpplimd  oloctric  fi*ld. 

Whil*  th*  Chang**  in  th*  bias  voltag*  at  th*  oporating 
fr*qu*ncy  of  th*  Hugh*s  d*vic*  ar*  much  fastar  than  th*** 
r*ori*ntatlon  tim**,  this  is  not  th*  cas*  with  th*  Loral  davic*. 

In  th*  cas*  of  th*  Loral  davic*,  w*  war*  initially  concarnad 
that  th*  raspons*  tim*  of  th*  molaculas  to  th*  changing  low 
fraquancy.  bias  voltag*  might  mask  changas  in  th*  output  du*  to 
Chang**  in  th*  input  light  intansity.  As  w*  will  s**,  thas* 
conearns  war*  Justifiad. 

Thar*  is  anethar  substantial  diffaranc*  batwaan  tha  two 
davieas.  Tha  Loral  davic*  doas  not  hav*  an  optical  blocking 
layer  placed  batwaan  th*  photocenducter  and  liquid  crystal  layers 
while  th*  Hughes  davica  does.  Tha  purpose  of  this  layer  is  to 
prevent  th*  reading  light  beam  from  passing  through  to  th* 
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photoconductor  and  •saantially  bacoming  a  Mrlting  baam.  In  tha 
caaa  tha  Loral  davica*  thia  oinisBian  appaars  to  ba  motivatad 
by  aconofflical  conaldarationa.  Tha  prica  o*  a  davica  mada  Mithout 
a  blocking  layar  Mill  ba  loMar.  Howavar,  tha  raadlng  baam  must 
ba  -filtarad  sinca  wavalangtha  longar  than  600  nm  will  ba 
transmittad  through  tha  dialactric  mirror  and  Mill  go  through  to 
tha  photoconductor.  This  can  praaant  aubatantial  diaadvantagaa 
ainca  laaar  dioda  and  convaniant  gaa  laaara  oparata  at  rad  or 
In-frarad  Mavalangtha. 

Tha  optimum  Mavalangth  'for  tha  raadlng  baam  Mill  dapand  on 
tha  typa  of  liquid  cryatml  uaad  aa  Mall  aa  tha  thicknaaa  of  tha 
liquid  cryatal  layar.  For  optimal  oparation,  tha  davica  ahould 
act  aaantially  aa  a  half  Mava  plata  convarting  tha  initial 
linaarly  polarizad  light  complataly  to  tha  orthogonal 
polarization.  Tha  total  biraf ringanca  of  tha  davica  can  ba 
variad  by  incraaaing  tha  thicknaaa  of  tha  liquid  cryatal  layar. 
Thia  thicknaaa  can  ba  altarad  for  optimum  raaponaa  at  a  daairad 
wavalangth.  HoMOvar,  tha  thicknaaa  cannot  ba  incraaaad 
indafinitaly  ainca  tha  tima  raaponaa  of  tha  davica  bacomaa  aloMor 
Mith  incraaaing  thicknaaa. 

Pattarna  can  ba  arittan  onto  tha  liquid  cryatal  ainca  tha 
tranavaraa  photoconductivity  ia  Iom  enough  to  alloM  a  apatial 
pattern  to  ba  impoaad.  Tharafora,  tha  locationa  of  tha 
biraf ringanca  Mill  eerraapond  Mith  thoaa  locationa  Mhara  tha 
photoconductor  haa  boon  affected  by  tha  ariting  baam.  Houaver, 
thia  introducaa  apatial  raaolution  or  tha  modulation  tranafar 
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function  (MTF)  a*  anoth*r  p*rformanc*  param*t*r. 

A*  th*  p*riod  of  a  spatial  pattern  d*cr*as**,  th*  separation 
of  th*  low  roBlstane*  portions  of  th*  photoconductor  layer 
decreases  along  with  the  separation  of  th*  portions  of  th*  liquid 
crystal  layer  which  are  subjected  to  th*  higher  bias  voltage. 
However,  there  is  some  deterioration  of  the  transverse 
photoconduct Ivy,  which  limits  the  ultimate  spatial  period 
obtainable.  This  will  be  shown  by  a  decrease  In  the  resolvable 
spatial  period  on  the  reading  side  as  th*  writing  spatial  period 
Is  decreased. 

A  variety  of  tests  measuring  these  parameters  were  performed 
on  th*  two  devices  Including  the  effects  of  changing  the  bias 
voltage*  bias  frequency,  wavelength  of  the  writing  beam,  risetime 
and  falltime,  MTF,  and  wavelength  of  the  reading  beam.  The 
results  of  these  tests  will  be  discussed  for  each  device. 
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III.  PERFORMANCE  OF  THE  HUGHES  LCLV 

A.  Introduction 

This  chapter  docum*nt«  th*  •xp*rim*ntal  m*a*ur*m*nt*  mad*  on 
th*  porformanc*  character istic*  O'f  th*  Hugh**  liquid  crystal 
light  valv*.  Wh*r*  appropriat*,  •Np*rim*ntal  d*tail*  will  b* 
pr*s*nt*d.  Sine*  littl*  oporating  information  wa*  giv*n  on  th* 
Loral  d*vic*(  w*  d*cid*d  to  •xamin*  th*  Hugh**  d*vic*  first  to 
*••  th*  motivation  for  th*ir  oparating  *p*cifi cations.  Than,  m* 
Mould  ba  abla  to  optimiza  tha  oparating  spacif ieations  for  tha 
Loral  davica. 
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B.  8«n«r«l  EKp«rim»nt«l  Sat'-up 

Th»  general  experimental  eet-up  ie  the  eame  as  reported 
earlier  (4).  An  Argon  ion  laser  with  an  output  at  514.5  nm  Mas 
used  as  the  writing  beam  since  previous  work  indicated  that  the 
CdS  photoconduct i ve  layer  is  sensitive  to  this  wavelength.  The 
laser  beam  was  spatially  'filtered,  expanded,  collimated,  and 
apertured  to  achieve  a  uni'form  intensity  distribution  across  a 
portion  o-f  the  photoconductor  layer. 

The  reading  beam  was  obtained  'from  a  Helium  Neon  laser  at  a 
wavelength  O'f  632.8  nm  which  was  also  spatially  filtered, 
collimated  and  apertured.  In  this  case,  the  aperture  diameter 
was  smaller  than  the  writing  beam  diameter  to  insure  that  the 
cross  sectional  area  of  the  reading  beam  was  smaller  than  the 
cross  sectional  area  of  the  writing  beam.  In  addition,  care  was 
taken  to  make  sure  the  two  beams  spatially  overlapped. 

The  linearly  polarized  Helium  Neon  laser  beam  passed  through 
a  polarization  beamsplitter  cube.  The  orthogonal  polarization 
state  of  the  reflected  light  was  then  separated  by  this 
beamsplitter  and  directed  to  a  photodetactor.  The  absolute 
incident  light  intensity  on  the  LCLV  was  measured  by  placing  the 
detector  directly  in  front  of  the  LCLV  or  by  inserting  a  quarter 
wave  plate  between  the  beamsplitter  and  the  LCLV. 

It  is  critical  that  the  initial  polarization  direction  of 
the  reading  light  be  parallel  to  the  direction  of  the  liquid 
crystal  molecules.  This  was  determined  by  rotating  the  LCLV 
until  the  reflected  light  was  nulled. 
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C.  Bias  Voltage 

Ms  -first  examined  the  operating  characteristics  of  the 
device  as  a  function  o-f  bias  voltage.  With  the  writing  beam 
turned  o-ff,  the  absolute  re-f lectlvi ty  of  the  Hughes  device  at  the 
Helium  Neon  laser  wavelength  of  632.8  nm  was  measured  as  a 
function  of  bias  voltage.  Experimental  results  are  shown  in 
Figure  5.  The  frequency  of  the  AC  voltage  was  chosen  to  be  10 
kHx  in  accordance  with  recommendations  from  the  manufacturer. 
However,  we  found  little  variation  in  the  performance  of  the 
light  valve  as  this  frequency  was  changed. 

Several  characteristics  are  seen  in  Figure  5.  The 
reflectivity  decreases  to  a  minimum,  goes  back  through  a  small 
peak,  decreases  again,  and  then  goes  through  a  large  peak  as  the 
bias  voltage  increases.  In  order  to  minimize  the  reflectivity 
when  there  is  no  writing  beam  (as  is  usually  desired),  a  bias  of 
10.3  VRfIS  is  used.  However,  if  a  maximum  response  is  desired  in 
the  absence  of  any  writing  beam,  a  bias  voltage  of  3.76  VRHS 
would  be  used.  The  consequences  of  this  will  be  noted  later. 

The  reflectivity  is  again  plotted  versus  the  bias  voltage  in 
Figure  6  for  a  writing  beam  intensity  of  58  mlcrowatts/cm*  at 
the  green  514  nm  wavelength  of  the  Argon  ion  laser.  Although  the 
curve  is  similar,  the  peaks  have  moved  to  lower  voltages.  In 
this  case,  the  fraction  of  the  bias  voltage  which  appears  across 
the  liquid  crystal  layer  increases  due  to  the  presence  of  the 
writing  beam. 

Therefore  if  the  bias  voltage  is  chosen  to  be  10.3  VRMS,  the 
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Ivcti vi ty  O'f  thm  d»vic«  Mill  incr»«s»  as  ths  writing  bsam 
intensity  increases.  This  will  be  examined  next. 
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BIAS  (MOLTS  RUS) 


Figure  S  -  Reflectivity  of  the  Hughes  LCLV  at  a  wavelength  of 
632.8  ne  as  a  function  of  AC  bias  voltage  applied  across  the 
device.  Here*  the  writing  beam  is  turned  off. 


D.  Writing  Sensitivity 

Measurements  were  made  O'f  the  absolute  rs'f lecti vity  O'f  the 
Hughes  device  at  a  reading  wavelength  oi  632.8  nm  as  a  function 
o-f  the  intensity  of  the  writing  beam  at  514.5  nm.  Figure  7  shows 
the  absolute  device  reflectivity  as  a  function  of  writing 
intensity  using  an  AC  bias  voltage  of  10.3  VRMS  and  shows  an 
increase  in  reflectivity  with  increasing  writing  intensity.  In 
this  experiment,  the  intensity  incident  on  the  LCLV  was  first 
measured.  Then  the  absolute  intensity  reflected  from  the  LCLV/ 
and  passed  by  the  beamsplitter  was  measured.  This  was  taken  as 
the  absolute  reflectivity,  assuming  a  perfect  beamsplitter.  Note 
that  moderately  low  intensities  of  50  -  100  microwatts/cm*  are 
able  to  achieve  high  reflectivities  of  60  -  80%. 

An  interesting  effect  can  be  obtained  by  changing  the  bias 
voltage  to  3.76  VRMS.  Here,  maximum  reflectivity  is  obtained  for 
zero  writing  input.  Increasing  the  writing  intensity  again 
causes  the  curve  in  Figure  5  to  move  to  the  left.  However,  for 
this  choice  of  bias  voltage,  the  reflectivity  will  now  decrease 
with  increasing  writing  intensity  as  shown  in  Figure  6. 

When  an  intermediate  bias  voltage  is  chosen,  the 
reflectivity  will  vary  as  the  curve  in  Figure  5  again  to  the  LEFT 
relative  to  that  bias  point.  Figure  9  shows  the  results  for  a 
bias  voltage  of  6.7  VRflS.  In  this  case,  the  maximum  reflectivity 
is  only  7%  and  peaks  at  an  intensity  of  30  microwatts/cm* 
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Figur.  7  -  R«fl«ctivity  of  tho  Hugh..  LCLV  at  f 

632.1  n.  ••  a  function  of  in-tting  light  inton.ity  at  a  «av.l.ngth 
of  514. 5  nm.  Th.  AC  bias  voltag.  i.  10.3  VRMS. 
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Figur*  8  -  Rsflsctivity  of  tho  Hughoo  LCLV  at  a  wavolongth  of 
A32.8  n«  ao  a  function  of  Mriting  light  intonaity  at  a  uavolongth 
of  914.9  no.  Tho  AC  bias  voltago  ia  3.74  VAMS. 
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Figura  f  -  Raflactivity  th«  Hughvs  LCLV  at  a  wavalangth  of 
632.0  nm  as  a  funetion  of  Mriting  light  intonsity  at  a  Mavslsngth 
of  S14.S  ns.  Ths  AC  bias  voltago  is  6.7  VRMS. 


Pag*  27 


E.  Writing  Wav*l«ngth  Sansitlvity 

As  mantionad  in  Chaptar  II.  th*  wavalangth  O'f  th«  writing 
baaffl  should  b*  chosan  to  hava  a  maximuin  a-f^act  on  tha 
conductivity  o-f  tha  photoconduct i va  layar.  Exparimanta  wara 
parformad  in  which  a  constant  intanaity  variabla  wavalangth 
aourca  waa  uaad  to  illuminata  tha  LCLV. 

Whita  light  waa  aant  through  a  di'f'fraction  grating 
monochromator  (having  a  bandpass  of  about  10  nm)  and  illuminatad 
tha  liquid  crystal  light  valva.  A  variac  on  tha  light  aourca 
allowad  tha  input  intanaity  to  ba  kapt  constant  at  40 
microwatts/cffi^.  Intanaitiaa  wara  maasurad  using  a  radiomatric 
filtar  on  an  ESfcG  datactor  ayatam. 

Figura  10  ahowa  tha  ralativa  raflactivity  of  tha  davica  aa  a 
function  of  writing  wavalangth  and  ahowa  a  vary  atrong  wavalangth 
raaponaa  charactariatic  of  tha  Cadmium  Sulfida  photoconductor 
layar.  Thia  curva  ahowa  tha  axtramaly  narrow  apactral  raaponaa 
of  thia  davica.  Howavar*  it  happana  to  coincida  with  tha  514  nm 
amiaaion  lina  of  tha  Argon  ion  laaar.  Nota  that  tha  raaponaa  is 
zaro  for  tha  488  nm  Argon  laaar  lina. 
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raspoHM  of  tho  Hughoo  LCLV  at  a  wavolangth 

intlnJiJw  *«"‘ttng  light  wavolongth  at  constant 

ntonslty.  Writing  wavolongth  bandpass  is  approNlmataly  10  nm. 
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F.  Rvadlng  Wavsivngth  Ssnsitivlty 

As  msntionsd  in  th«  Chspsr  II,  th*  polarization  o-f  thm 
rsading  bsam  changss  du«  to  inducsd  biraf ringsncs  in  tha  liquid 
crystal  layar.  Tha  dagraa  a-f  biraf ringanca  not  only  dapands  on 
tha  inducad  oriantation  changas  in  tha  liquid  crystal  layar  but 
also  on  tha  thicknass  o-f  tha  liquid  crystal  layar  and  tha 
wavalangth  o'f  tha  raading  baam.  Tha  thicknass  can  ba  tunad  to 
maximiza  tha  dagraa  of  biraf ringanca  for  a  chosan  wavalangth. 

Maasuraaants  of  tha  ralativa  rafl activity  of  tha  light  valva 
as  a  function  of  raading  wavalangth  wara  carriad  out.  Input 
whita  light  was  sant  onto  tha  light  valva  through  a  diffraction 
grating  monochrofflator  having  a  bandpass  of  about  10  nm. 

Light  raflactad  at  a  slight  angls  was  collactad  by  a 
datactor.  Tha  polarization  baamsplittar  cuba  was  not  usad 
bacausa  its  rafl activity  is  not  constant  as  a  function  of 
wavalangth. 

Tha  datactor  was  first  usad  to  maasura  tha  incidant  light 
intansity  at  tha  LCLV  and  than  tha  raflactad  intansity.  As 
baforSf  tha  datactor  had  a  radioaatric  filtar  to  giva  a  constant 
rasponsa  as  a  function  of  wavalangth. 

Tha  rasults  of  this  axparimant  ara  shown  in  Figura  11  and 
show  that  this  daviea  thicknass  is  tunad  to  tha  Halium  Naon  lasar 
wavalangth. 


225 


P*Q»  30 


475  525  575  S25  675  725  775  825 
READ  HAUELENGTH  <NH) 


Flgur*  n  -  Rslatlva  rasponM  oF  th»  Hughn  LCLV  u  *  function  of 
reading  light  M«v»l«ngth. 


G.  Raspons*  Tima  Maaauramanta 

Riaa  and  fall  timas  for  tha  Hughas  davica  wara  maaaurad.  In 
tha  axparimantal  satup,  a  ahuttar  machaniam  waa  uaad  to 
illuminata  tha  LCLV  with  a  S  aacond  pulaa  at  tha  Argon  laaar  lina 
of  514. S  nm.  Tha  raflactad  light  at  a  wavalangth  of  632.8  nm  was 
than  monitorad  aa  a  function  of  tima  uaing  a  datactor.  Syatam 
riaatima  and  falltimaa  wara  maaaurad  by  ahining  tha  writing  light 
diractly  onto  tha  datactor  and  wara  aubatantial ly  ahortar  than 
tha  LCLV  raaponaa  tima. 

Figura  12  ahowa  tha  raflactad  aignal  aa  a  function  of  tima 
for  diffarant  writing  intanaitiaa.  Tha  bottom  curva  ahowa  tha 
ayatam  raaponaa.  Tha  thraa  highar  curvaa  ahow  tha  tima 
dapandanca  of  tha  rafl activity  for  writing  baam  intanaitiaa  of 
11,  26,  and  66.5  mierawatta/cm=*. 

Tha  figura  ahowa  a  complicating  faatura  at  tha  lowar  writing 
intanaitiaa.  In  this  caaa,  tha  raflactivity  riaaa  initially  vary 
quickly,  than  pauaaa,  and  incraaaaa  much  mora  alowly.  A 
daacription  of  tha  tima  proftla  ia  tharafora  vary  complicatad. 

Tha  tima  raquirad  to  raach  90X  of  tha  final  valua  ia  axtramaly 
long  whlla  tha  SOX  tima  is  still  quita  short.  Wa  dacidad  to  taka 
tha  SOX  points  sinca  this  faatura  ramainad  qual itativaly 
unehangad.  Valuaa  for  both  tha  riaatima  and  falltimaa  as  a 
function  of  writing  light  intanaity  ara  shown  in  Figura  13.  Tha 
fall tima  ia  ralativaly  conatant  at  about  3S  maac.  Howavar,  tha 
riaatima  daeraaaaa  rapidly  aa  input  writing  intanaity  incraaaaa 
raaching  valuaa  aa  low  aa  20  maac. 
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Figure  12  -  Raflvctivity  o*  th»  Hughvs  LCLV  at  a  mtavalangth  of 
632.8  n«  aa  a  function  of  titno  for  difforont  writing  light 
intonaitios  of  (from  top)  64. 9«  26*  and  11  microwatt a/cm*.  Tho 
bottom  traca  ahowa  tha  writing  aignal  aa  a  function  of  tima  for  a 
S  aacond  pulaa. 
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Figur#  13  -  RlMtim#  and  falltim*  of  tho  rofloctlvity  of  th* 
Hugh#*  LCLV  at  a  Mav#l#ngth  of  632.8  n«  for  dtff#r#nt  writing 
light  intanaiti##.  Th#  tim##  giv#n  ar#  th#  tin#*  r#quir#d  to 
roach  SOX  of  th#  total  roopons#. 
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H.  Modulation  Transfer  Function 

A  Twyman  Qr**n  intorforofflotor  Mas  us*d  to  Mrit*  sinusoidal 
patterns  on  th*  LCLV.  By  changing  th*  int*noiti*s  of  light  from 
th*  two  mirrors  of  th*  int*rf •roffl*t*r ,  th*  modulation  ind*x  of 
th*  writing  b*am  could  b*  changad. 

Th*  r*ad  b*am  was  r*fl*ct*d  off  th*  LCLV,  pass*d  through  th* 
polarization  splitting  cub*  baamspl i tt*r ,  and  s*nt  through  a  36. B 
cm  focal  longth  Fourier  transform  l*ns  to  a  linsar  diod*  array. 
Th*  diffraction  pattern  consists  of  a  large  zero  order  peak  plus 
two  sidebands  as  shown  in  Figure  14.  As  the  tilt  of  on*  of  th* 
mirrors  in  the  Twyman  Green  interferometer  increases,  the  spatial 
period  of  th*  sinusoidal  pattern  decreases.  Therefore  th* 
location  of  th*  first  order  diffracted  peak  moves  away  from  th* 
zero  order  peak  and  is  detected  by  different  elements  of  the 
linear  diode  array.  As  the  response  of  th*  LCLV  to  higher 
spatial  frequencies  decreases,  the  intensity  of  the  first  order 
peak  decreases,  allowing  direct  measurement  of  th*  MTF. 

Figure  IS  shows  representative  curves  showing  an  overlay  of 
th*  diffracted  intensities  in  the  focal  plane  of  th*  lens  as  th* 
tilt  of  the  interferometer  change*.  The  four  peaks  all 
correspond  to  the  first  order  peak  and  clearly  show  the 
decreasing  respose  at  higher  spatial  frequencies. 

Figure  16  shows  the  resulting  normalized  MTF  curve.  Th* 
spatial  frequency  corresonding  to  the  SOX  point  is  about  11 
1 inss/mm. 
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Flgur#  14  -  Dif-fr«ctlon  pattern  of  tho  rood  boom  using  tho 
intorforomotor  tochniquo  dlscussod  in  tho  toxt.  Tho  DC  ond  two 
first  ordor  pooks  oro  shown. 
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Flgur*  15  -  R»latlv«  h«ight«  o4  th»  4lr»t  ord«r  diffracted  peaks 
of  the  reading  beam  as  a  function  of  spatial  frequency  in  the 
Nriting  beam. 
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Figur*  16  -  MTF  Curv*  for  Hugh**  LCLV 
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I.  Tim*  Rasponsa  va.  Spatial  Fr aquancy 

An  axparimant  waa  carriad  out  aMamining  tha  tima  dapandanca 
O'f  a  apatial  pattarn  aa  a  function  of  apatial  fraquancy.  Uaing 
tha  pravioua  aatup,  a  aingla  datactor  raplacad  tha  datactor  array 
and  waa  poaitionad  to  datact  tha  firat  ordar  diffractad  paak. 

Than  a  ahuttar  waa  uaad  to  turn  on  tha  writing  baam  aa  diacuaaad 
in  Saction  6.  Tha  tima  dapandanca  of  tha  diffractad  paak  waa 
aKafflinad  for  diffarant  apatial  fraquanciaa  in  tha  writing  baam 
pattarn.  No  aignificant  diffarancaa  wara  obaarvad. 


J.  Concluaions  Ragarding  th*  Parformanc*  of  tho  Hughaa  Oavica 

Tha  Hughaa  davica  parforma  axtramaly  wall.  Writing  baam 
intanaitiaa  of  only  SO'-lOO  microwatta/cm^  ara  raquirad  to 
achiava  modarata  raf lactivitiaa.  Tha  maKimum  raflactivity  of  tha 
davica  ia  about  80%. 

Tha  writing  wavalangth  ranga  ovar  which  tha  davica  ia 
aanaitiva  ia  unf ortunataly  narrow  and  ia  datarminad  by  tha  choica 
of  CdS  aa  tha  photoconducti va  layar.  Navarthalaaa,  thia  apactral 
ragion  ovarlapa  nicaly  with  tha  amiaaion  wavalangtha  of  phoaphora 
uaad  in  CRT  and  imaga  intanaifiar  tubaa  aa  wall  aa  tha  514.5  nm 
amiaaion  lina  of  tha  Argon  laaar.  Howavar,  nawly  davalopad 
davicaa  by  Hughaa  uaa  a  ail icon  photoeonductor  (9)  and  tho 
wavalangth  raaponaa  ia  much  broadar. 

Tha  curva  of  raflactivity  varaua  writing  baam  intanaity  can 
ba  variad  by  propar  choica  of  tha  biaa  voltago.  For  normal 
oparation,  valuaa  naar  10.3  VRnS  muat  ba  choaan.  Howavar,  an 
intoraating  rovaraa  contrast  mode  can  bo  obtainad  for  a  low  biaa 
voltaga  of  3.73  VRffS. 

Raaponaa  timaa  ara  in  tha  20  ~  35  millisacond  ranga. 

Spatial  raaolution  is  also  good  with  tha  SOX  MTF  point  at  about 
11  linaa/mm. 

Ovarally  wa  fait  that  this  davica  parformad  SKtramaly  wall. 
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IV.  PERFORMANCE  OF  THE  LORAL  LCLV 

A.  Introduction 

A«  was  msntionsd  ssrlisr,  ths  Loral  dovica  is  still  in 
dovalopmant  stagas.  Whan  wa  racaivad  tha  davica,  tha  oparatlng 
instructions  wars  vagua  ragarding  writing  sansitivity,  writing 
wavalangth,  raading  wavalangth,  and  oparating  fraquancy.  Wa 
axpariancad  a  graat  daal  of  difficulty  in  gatting  tha  davica  to 
work  for  two  raasons. 

First,  tha  amount  of  writing  intansity  which  was  raquirad  is 
substantially  graatar  than  in  tha  casa  of  tha  Hughas  davica  and 
is  also  much  graatar  than  praviously  publishad  (6).  Wa  lost  soma 
tima  bafora  discovaring  this. 

Sacondly,  wa  lost  a  substantial  amount  of  tima  dua  to  a 
crack  davaloping  in  tha  conducting  apoxy.  This  pravantad  tha 
bias  voltaga  from  raaching  tha  davica  packaga.  Wa  rapairad  this 
by  applying  a  naw  coat  of  conducting  apoxy.  Howavar,  this  raisad 
quastions  about  tha  durability  of  tha  davica. 

Wo  rapaatad  tha  saaa  sari as  of  tasts  on  this  dovica  as  on 
tha  Hughas  davica. 
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B.  0*n*ral  Expsrlmantal  S*tup 

Th*  g*n*ral  ax p*ri mental  **tup  was  conceptually  the  earn*  ae 
discueeed  earlier.  However,  w*  did  not  uea  th*  Argon  laser  in 
th*  initial  experiments  ^or  two  reasons.  First,  w*  wanted  to 
examine  th*  writing  wavelength  sensitivity.  Secondly,  th*  amount 
o#  writing  light  intensity  was  greater  than  w*  were  able  to 
obtain  with  our  Argon  laser. 

Th*  writing  source  was  a  100  Watt  tungsten  light  source 
manufactured  by  Oriel  which  was  spectrally  filtered  to  obtain  a 
moderately  monochromatic  source.  High  and  low  pass  optical 
filters  having  cut-off  wavelengths  spaced  by  50  nm  were  combined 
in  series  to  create  a  series  of  SO  nm  wide  spectral  sources. 

This  bandwidth  was  sufficient  to  obtain  sufficient  writing  light 
intensities  to  conduct  the  experiments. 

The  reading  light  beam  was  a  Helium  Neon  laser  beam  as 
before. 
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C.  Bia*  Voltag* 

With  th*  writing  baam  turned  O'f'f,  th*  absolut*  reflectivity 
of  th*  Loral  device  was  measured  as  a  function  of  bias  voltage 
and  results  are  shown  in  Figure  17.  Th*  bias  frequency  was  fixed 
at  90  Hz  which  is  much  higher  than  recommended  by  the 
manufacturer.  Th*  reasons  for  this  will  become  clearer  in  future 
sections. 

The  observed  characteristics  are  similar  to  those  seen  with 
the  Hughes  device.  The  reflectivity  is  initially  high,  decreases 
to  a  minimum,  goes  back  through  a  small  peak,  decreases,  and  then 
goes  through  a  largo  peak  again. 

In  order  to  minimize  the  reflectivity  when  there  is  no 
writing  beam  (as  is  usually  desired),  a  bias  of  2.59  VRHS  would 
be  used.  However,  if  maximum  reflectivity  is  desired  in  the 
absence  of  any  writing  beam,  a  bias  voltage  of  3.48  VRMS  would  be 
used.  The  consequences  of  this  have  already  been  discussed  in 
the  case  of  the  Hughes  device  and  will  also  be  noted  later. 

The  reflectivity  as  a  function  of  bias  voltage  is  next 
plotted  in  Figure  18  for  a  writing  beam  intensity  of  2.S 
mil 1 iwatts/cm*. 

In  this  ease,  the  writing  beam  has  a  50  nm  spectral  width 
centered  at  425  nm.  As  in  the  case  of  the  Hughes  device,  the 
curve  is  the  same  except  that  the  peaks  have  moved  to  lower 
voltages.  As  before,  a  larger  fraction  of  the  bias  voltage 
appears  across  the  liquid  crystal  layer  because  of  the  presence 
of  the  writing  beam  and  the  reflectivity  of  the  device  has 
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incr»«m»d. 

Th«r»‘for»,  if  th«  bias  voltaq*  i«  choaan  at  2.S9  VRMS,  tha 
raflactivity  will  ineraasa  aa  tha  writing  baam  intanaity 
incraaaaa.  Naxt  tha  wavalangth  aanaitivity  of  tha  writing  baam 
will  ba  axaminad. 

Aa  in  tha  caaa  of  tha  Hughaa  davica,  it  ia  critical  that  tha 
plana  of  polarization  for  tha  incidant  light  ba  parallal  to  tha 
diraction  of  tha  liquid  cryatal  molaculaa  at  tha  aurfaca.  Ma 
obaarvad  that  alight  rotationa  of  tha  davica  ahiftad  tha  blaa 
voltaga  curva  alightly. 
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Figur*  17  -  R«41«etivlty  of  tho  Loral  LCLV  at  a  Mavolongth  of 
A32.8  nm  a*  a  function  of  AC  bias  voltago  appliod  across  tho 
dovico.  Hors,  tho  writing  boao  is  turnod  off. 
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Figur*  IB  >  R»fl«ctivity  of  tho  Loral  LCLV  at  a  Mavolongth  of 
632. B  no  aa  a  function  of  AC  bias  voltago  appllod  across  tho 
dovlco.  HorO(  a  oriting  boao  of  2.S  milliwatts/co*  contorotf  at 
625  no  is  usod. 
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D.  Writing  Waval«ngth  Ssnsitivity 

Aa  mantionad  in  tha  introduction,  tha  wavalangth  of  tha 
writing  baam  should  ba  chosan  to  hava  a  maximum  a-ffact  on  tha 
changa  in  tha  photoconduct iva  layar.  Sinca  wa  had  no 
axparimantal  data  on  propar  writing  wavalangths,  wa  dacidad  to 
par'form  this  axparimant  ba-fora  conducting  aansitivity 
axparimanta.  Figura  19  shows  tha  ralativa  ra^lactivity  of  tha 
davica  as  a  function  of  tha  writing  wavalangth  and  shows  a  vary 
strong  wavalangth  rasponsa  charactaristic  of  tha  AsaSas 
photoconductor  layar. 

In  this  axparimant,  tha  writing  light  was  spactrally 
filtarad  using  high  and  low  pass  intar faranca  filtars  and  tha 
intansity  was  kapt  constant  at  0.8  mi  1 1  iwatts/cm^.  Thi<« 
axparimant  shows  that  tha  spactral  ragion  naar  625  nm  is  the 
optimum  writing  wavelength  ragion  and  that  tha  Argon  laser  is  not 
wall  suited  for  this  device. 

However,  tha  Helium  Neon  laser  wavelength  is  vary  wall 
suited  for  this  device.  Hewavar  as  mentioned  earlier,  tha 
absence  of  any  light  blocking  layar  will  causa  soma  leakage  of 
this  light  into  tha  reading  sida  of  tha  LCLV. 
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E.  Mriting  Sansitlvity 

One*  tha  optimum  writing  wavalangth  w«a  ^ound,  tha  absoluta 
ra-f lactivity  of  tha  Loral  davica  at  a  raading  wavalangth  of  632.8 
nm  waa  maaaurad  as  a  function  of  tha  intansity  of  tha  writing 
baam  intansity.  Hara  tha  spactral  composition  of  tha  writing 
baam  corraspondad  to  tha  moat  sansitiva  wavalangth  rasponsa 
ragion  and  had  a  bandwidth  of  SO  nm  cantarad  at  625  nm. 

Figura  20  shows  tha  davica  raf lactivity  as  a  function  of 
writing  Intansity.  Slnca  tha  davica  bias  was  chosan  to  ba  2.59 
VRMS,  tha  raflactivity  incraasad  with  Incraasing  writing 
intansity.  Nota  that  modarataly  high  intansitias  of  4 
milliwatts/cm*  ara  naadad  to  achiava  modarata  raf lacti vi tias  of 
about  60%.  Thasa  intansitias  ara  much  highar  than  in  tha  casa  of 
tha  Hughas  davica. 

A  sansitivity  maasuramant  using  tha  Mali  urn  Naon  lasar  as  tha 
writing  sourca  gava  idantical  rasults. 

An  intarasting  affact  takas  placa  is  tha  bias  voltaga  is 
chosan  at  3.48  VRMS.  Racall  that  in  this  casa,  tha  raflactivity 
was  a  maximum  whan  tha  writing  intansity  was  zaro.  Now  as  tha 
Intansity  of  tha  writing  baam  incraasas,  tha  curva  shown  in 
Figura  17  again  movas  to  tha  laft  causing  tha  raflactivity  to 
dacraasa. 

This  is  shown  in  Figura  21  and  shows  tha  raflactivity 
dacraasing  as  tha  writing  baam  intansity  incraasas. 
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Figura  21  —  Rafl activity  of  tha  Loral  LCLV  at  a  wavalangth  of 
632.8  nm  aa  a  function  of  »«riting  light  intansity  at  a  Mavalangth 
of  629  nm.  Tha  AC  biaa  voltaga  ia  3.48  VRnS. 
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F.  Reading  Wavelength  Sensitivity 

As  mentioned  in  Chapter  II,  the  polarization  state  O'f  the 
reading  beam  changes  due  to  induced  birefringence  in  the  liquid 
crystal  layer.  The  degree  of  birefringence  not  only  depends  on 
the  induced  changes  in  the  liquid  crystal  layer  but  also  on  the 
thickness  of  the  liquid  crystal  layer  and  the  wavelength  of  the 
reading  beam.  The  thickness  can  be  tuned  to  maMimize  the  degree 
of  birefringence  for  a  chosen  wavelength. 

Measurements  of  the  reflectivity  of  the  light  valve  as  a 
function  of  reading  wavelength  were  carried  out.  The 
experimental  setup  was  the  same  as  with  the  Hughes  device.  Input 
light  was  sent  onto  the  light  valve  through  a  diffraction  grating 
monochromator  slightly  off  normal  incidence.  The  reflected  light 
was  collected  by  a  detector.  The  polarization  beamsplitter  cube 
was  not  used  because  of  its  wavelength  response. 

The  detector  measured  both  the  incident  light  intensity  at 
the  LCLV  and  then  the  reflected  intensity.  As  before,  the 
detector  had  a  radiometric  filter  to  give  a  constant  response  as 
a  function  of  wavelength. 

The  results  of  this  are  shown  in  Figure  22  and  show  that 
this  device  thickness  is  tuned  to  the  Helium  Neon  laser 
wavelength.  However,  note  from  the  earlier  discussion  that  the 
lack  of  a  blocking  layer  would  allow  a  portion  of  the  reading 
light  at  these  wavelengths  to  be  transmitted  to  the 
photoconductor  and  act  as  a  writing  beam. 
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READ  HAUELENGTH  (NH) 


FlQurs  22  -  Ralativs  rssponM  o-f  th»  Loral  LCLV  as  a  ♦unction  of 
reading  light  Mavolongth. 
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6.  Bias  Voltag*  Fr*qu*ncy  Rcspons* 

Th*  instructions  -for  th*  Loral  davic*  sugg*st*d  using  bias 
fr*qu*nci*s  o-f  only  10  -  40  Hz.  This  is  much  low*r  than  in  th* 
cas*  o-f  th*  Hughes  dsvic*.  W*  noted*  when  using  a  1  Hz  bias 
frequency,  that  th*  reflected  intensity  would  flicker.  Me  became 
concerned  with  this  behavior  since  th*  flicker  would  be 
indistinquishabl*  from  changes  in  the  incident  light  intensity 
level. 

To  check  this,  we  performed  tests  with  a  transient  writing 
intensity  for  a  variety  of  bias  frequencies  and  a  given  bias 
voltag*.  This  not  only  enabled  us  to  study  the  dependence  on  th* 
reflectivity  with  bias  frequency,  but  also  permitted  a  study  of 
the  risetime  characteristics  of  the  device. 

As  in  the  related  eKperiment  which  we  did  on  the  Hughes 
device,  the  writing  light  was  sent  through  a  shutter  with  an 
exposure  time  of  2  seconds.  The  reflected  signal  was  again  sent 
to  a  fast  detector  and  recorded.  The  system  risetime  was  much 
faster  than  the  time  response  of  the  LCLV. 

Figure  23  shews  the  reflected  signal  for  a  bias  frequency  of 
20  Hz.  Net  only  is  the  risetime  extremely  slow,  but  there  is  a 
substantial  ripple  since  the  liquid  crystal  molecules  are 
reacting  to  the  changing  bias  voltage.  The  ripple  frequency 
follows  the  bias  frequency. 

Figures  24~2h  show  the  experi mental  results  at  bias 
frequencies  of  60,  90,  and  160  Hz.  Wo  see  that  the  absolute 
reflectivity  passes  through  a  maximum  and  then  decreses  with 
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incraasing  bias  'frsqusncy.  In  addition,  tho  ripplo  dsersasas 
with  incraasing  bias  'fraquancy  whila  its  frsquancy  incraasas. 
Figuras  27  and  28  plot  tha  ralativa  rasponsa  and  parcant  rippla 
as  a  function  of  bias  fraquancy.  Thasa  curvas  show  that  tha 
oparating  condition  which  maxintizas  tha  rasponsa  whila 
simultanaously  rninifliizing  tha  rippla  occurs  at  a  bias  fraquancy 
of  90  Hz.  This  was  tho  valuo  usually  usad  in  tha  axporimonts 
roportad  aarliar. 
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Figura  23  -  Rsflaetivity  of  tho  Lor 
632. ■  nm  as  a  function  of  tioo  for 
Hz. 
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Fiqura  26  -  RS'f  Isctivity  of  tho  Loral  LCLV  at  a  wavolongth  of 
632.8  no  aa  a  function  of  timo  for  a  bias  voltaqo  froquoncy  of 
160  Hz. 
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Figur*  28  -  Pareant  rlppl*  for  tho  Loral  LCLV  as  a  function  of 
bias  voltag*  froquoney. 


j 

5 


Pags  61 


H.  Raspenso  Tima 

Riaa  and  -fall  timaa  'for  tha  Loral  davica  wara  maasurad  ualng 
tha  mama  axparimantal  aatup  as  In  tha  pravioua  aaction.  Howavar, 
wa  mada  maaauramanta  o-f  thair  dapandanca  on  both  tha  biaa 
fraquancy  and  on  writing  intanaity. 

Pigura  29  ahowa  that  tha  riaatima  dacraaaaa  with  incraaaing 
biaa  fraquancy  and  flat tana  out  abova  60  Hz. 

Figura  30  ahowa  that,  uaing  a  biaa  fraquancy  of  90  Hz,  tha 
riaatima  and  falltima  ara  ralativaly  indapandant  of  writing 
intanaity  and  ara  about  SO  and  20  milliaaconda  raapacti valy. 
Thaaa  numbara  compara  wall  with  raaulta  uaing  tha  Hughaa  davica. 


20  40  60  80  100  120  140  160 
BIAS  FREQUENCY  <HZ> 


Figura  29  -  Raspensa  tima  of  tha  Loral  LCLV  as  a  function  of  bias 
fraquaney. 
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Figura  30  -  RMponM  tim«  of  tho  Loral  LCLV  as  a  function  of 
writing  light  intsnsity. 
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I.  Modulation  Transfer  Function 

As  in  tho  cass  of  tho  Hughss  dovics,  a  Tnyman  Grson 
intarf orometar  was  usad  to  writa  sinusoidal  pattarns  on  tha  LCLV. 
Howavar,  we  wara  not  abla  to  obtain  any  raportabla  axparimantal 
rasults  dua  to  tha  fact  that  tha  Argon  lasar  is  not  wall  suitad 
for  writing  on  tha  Loral  davice.  As  raportad  aarliar,  tha 
photoconductor  usad  in  tha  Loral  davica  is  quits  insansitiva  to 
tha  Argon  lasar  wavalangth.  Aftar  spatially  filtaring, 
axpanding,  and  aparturing  tha  Argon  lasar  baam,  wa  wars  unabla  to 
obtain  sufficiant  writing  intansitias.  In  fact,  wa  maasurad  a 
raflactivity  of  only  S5i  with  an  incidant  intansity  at  S14.5  nm  of 
2  mi  1 1 i watts/cffl^.  Mhan  wa  ramovad  tha  spatial  filtar  and 
changad  tha  collimating  optics  to  obtain  a  highar  writing 
intansity,  tha  writing  baam  uniformity  was  insufficiant  and 
dagradad  tha  MTF  of  tho  writing  systom.  Tharofora,  this 
intorf oromatric  tachniquo  could  not  ba  carriod  out. 
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J.  Conclusions  Rsgsrding  ths  Ssnsltivity  of  ths  LORAL  Dsvics 

As  msntionsd  ssrlisr,  ths  Loral  dsvics  is  still  in 
dsvslopmsnt  stagss  and  su-f-fsrs  'from  a  lack  of  dstailsd  opsrating 
instructions.  Wo  -found  that  ths  rscomfflsndations  givsn  by  ths 
manuf actursr  wsrs  incomplsts  and  o-ftsn  incorrsct.  In  addition, 

MS  had  troublss  with  ths  structural  ruggsdnsss  o-f  ths  dsvics. 

Ths  chis-f  drawback  to  this  dsvics  is  that  it  is 
substantially  Isss  ssnsitivs  than  ths  Hughss  dsvics.  Writing 
bsafli  intsnsitiss  o-f  2  -  3  milliwatts/cffl^  ars  rsquirsd  to 
achisvs  modsrata  rsf Iscti vitiss.  Ths  maximum  rs-f Isctivity  of  ths 
dsvics  is  about  60%  which  is  good. 

Ths  wavslsngth  rangs  ovsr  which  ths  dsvics  is  ssnsitivs  is 
much  broadsr  than  in  ths  cass  of  ths  Hughss  dsvics  but  is 
csntsrsd  in  ths  rsd  spsctral  rsgion.  Thsrsfors  it  offsrs  a  good 
match  with  ssvsral  rsd  and  nsar — infrarsd  lassr  sourcss. 

Ths  lack  of  ths  light  blocking  laysr  prsssnts  a  ssrious 
obstacls  sines  many  common  diods  lassr  sourcss,  which  might  bs 
ussd  in  corrslators,  opsrats  at  thsss  wavslsngths. 

As  in  ths  cass  of  ths  Hughss  dsvics,  ths  cur vs  of 
rsflsctivity  vorsus  writing  bsam  intsnsity  can  bs  varisd  by 
propsr  choics  of  ths  bias  voltags.  For  normal  opsration,  valuss 
nsar  2.59  VRHS  must  bo  chossn.  Howsvsr,  an  intorssting  rsvorso 
contrast  mods  can  bo  obtainsd  for  a  bias  voltags  of  3.48  VRHS. 

Ws  found  substantial  variation  in  ths  dsvics  porformancs  as 
a  function  of  bias  voltags  frsqusncy  which  affsetod  ths  absoluts 
rssponss,  ripplo,  and  timo  rssponss.  Ws  rscommsnd  a  bias  voltags 
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fraquancy  O'f  90  Hz  which  is  much  highsr  than  rscommsndsd  by  tha 
manu'f  acturar . 

Tha  di'f'faranca  in  tha  oparating  fraquancias  'for  tha  Loral 
and  Hughas  davicas  can  ba  attributad  to  tha  diffarant  aquivalant 
circuits  attributad  to  tha  various  constituant  layars  including 
tha  photoconductor,  tha  mirror,  tha  liquid  crystal,  and  tha 
optical  blocking  layar.  This  affactiva  circuit  which  includas 
tha  dioda  formad  by  tha  photoconduc tor /mirror  layar  is  dr i van  by 
tha  AC  voltaga  and  has  an  optimum  driving  fraquancy.  It  is 
impossibla  to  pradict  this  optimum  fraquancy  without  saparataly 
tasting  aach  of  tha  componants.  Naithar  Loral  nor  oursalvas  was 
willing  to  taar  apart  tha  davicas  to  do  this.  Tharafora,  wa  hava 
only  raportad  tha  total  fraquancy  rasponsa. 

Tha  rasponsa  tima  of  tha  davica  was  cartainly  adaquata  onca 
tha  propar  oparating  fraquancy  was  obtainad. 

Tha  insansiti vi ty  of  tha  davica  in  tha  graan  spactral  ragion 
pravantad  our  making  MTF  maasuramants. 

Tha  final  sactien  will  offar  a  faw  diract  comparisons  and 
conclusions. 
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V.  DISCUSSION 

Baaad  on  th«  moasurafflonts  raportad  in  tha  laat  two  chaptara, 
wa  racofflmand  using  tha  currant  varaion  O'f  tha  Hughaa  davica  ovar 
tha  currant  varaion  af  tha  Loral  davica  'for  usa  in  an  optical 
corralator  at  this  tima. 

First,  in  comparing  tha  aanaitivity  at  tha  optimum 
Naval angth  for  aach  davica,  tha  Hughaa  LCLV  is  mora  sansitiva  by 
a  factor  of  30.  Tha  Hughaa  LCLV  raquiraa  Nriting  intanaitlaa  of 
only  SO-100  microNatta/cm^  to  achiava  modarata  raf lacti vitiaa. 

Tha  maximum  rafl activity  of  tha  Hughaa  LCLV  ia  about  SOX.  By 
contraat,  tha  Loral  LCLV  raquiraa  Nriting  baam  intanaitlaa  of  2  * 
3  mi  1 1 iNatta/cffl^.  Tha  maximum  rafl activity  of  tha  davica  ia 
about  60X.  In  raporting  thia,  Na  nota  a  atill  unaxplainad 
diacrapancy  batNaan  our  maaauramanta  of  tha  Nriting  poNara  naadad 
for  tha  Loral  davica  Nith  tha  aarliar  raportad  valuaa  (6). 

Sacondly,  although  tha  Nriting  Navalangth  aanaitivity  for 
tha  Hughaa  davica  ia  axtramaly  narroN,  thia  apactral  ragion 
ovarlapa  nicaly  Nith  tha  amiaaion  Navalangtha  of  phoaphora  uaad 
in  CRT  and  imaga  intanaifiar  tubaa  aa  Nall  aa  Nith  tha  S14.5  nm 
amiaaion  lina  of  tha  Argon  laaar.  HoNavar,  a  naNly  davalopad 
LCLV  by  Hughaa  uaaa  a  ail icon  photoconductor  (9)  and  tha 
Navalangth  raaponaa  ia  much  broadar.  By  contraat,  tha  apactral 
raaponaa  of  tha  Loral  LCLV  la  much  broadar  than  in  tha  caaa  of 
tha  Hughaa  LCLV  but  ia  cantarad  in  tha  rad  apactral  ragion. 
Tharafora,  it  doaa  not  match  tha  phoaphor  Navalangtha  mantionad 
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•bov*. 

Both  d*vic**  hav*  a  broad  roading  Mav*l*ngth  s*nsitivity 
which  ha*  b**n  maKimizad  -for  th*  rad  spoctral  ragion.  This  is 
'fortunat*  sinca  most  corral ators  would  usa  died*  lasar  sourcas 
-for  th*  raading  baams.  Howavar,  th*  lack  of  tha  light  blocking 
layar  in  th*  Loral  LCLV  prasants  a  sarious  obstacl*  sine*  a 
portion  of  th*  raading  baam  would  pass  through  th*  light  blocking 
layar  and  sarva  as  a  writing  baam.  This  problam  is  compoundad 
sinca  th*  writing  wavalangth  sansitivity  curv*  for  th*  Loral  LCLV 
is  paakad  in  this  rad  spactral  ragion.  Tharafora,  w*  would 
racommand  inclusion  of  this  light  blocking  layar  into  th*  Loral 
LCLV. 

Both  davicas  oparatad  in  similar  fashions.  Th*  curv*  of 
rafl activity  varsus  writing  baam  intansity  can  b*  variad  by 
propar  choic*  of  tha  bias  voltaga.  In  both  casas,  tha  davicas 
could  b*  oparatad  with  incraasing  raflactivity  for  Incraasig 
writing  intansity  or  in  a  ravarsa  mod*. 

Th*  Loral  LCLV  has  an  advantags  in  that  its  oparating 
fraquaney  and  oparating  AC  bias  voltaga  ar*  substantially  lowar 
than  tha  Hughas  davica.  Wa  found  substantial  variation  in  tha 
Loral  LCLV  parforaanca  as  a  function  of  bias  voltaga  fraquaney 
which  affaetad  tha  absoluta  rasponsa^  rippla,  and  tima  rasponsa. 
Wa  racommand  a  bias  voltaga  fraquaney  of  90  Hz  which  is  much 
highar  than  raeommandad  by  tha  manuf acturar . 

By  following  our  racommandations  and  raising  tha  oparating 
fraquaney  to  tha  90  Hz  ranga*  sarious  rippla  in  th*  raflactivity 
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as  a  function  of  tima  can  ba  avoidad  without  sacrificing 
rasponsivity. 

Rasponsa  timas  for  both  davicas  ara  in  tha  20  -  60  msac 
ranga  and  ara  adaquata  for  most  applications.  Tha  Hughas  LCLV 
was  slightly  fastar. 

Spatial  rasolution  is  also  good  in  tha  casa  of  tha  Hughas 
LCLV  with  tha  soy.  liTF  point  at  about  11  linas/mm.  Wa  war  a  unabla 
to  maka  tha  MTF  maasuramant  on  tha  Loral  LCLV  bacausa  of  its 
insansitivi ty  in  tha  graan  spactral  ragion  at  which  our  argon 

lasar  oparatas. 

Finally,  tha  Loral  LCLV  is  still  in  davalopmant  stagas 
comparad  to  tha  Hughas  LCLV.  Wa  faal  that  tha  structural 
ruggadnass  of  tha  Loral  LCLV  must  ba  substantially  improvad.  In 
addition,  tha  Loral  LCLV  suffars  from  a  lack  of  datailad 
oparating  instructions.  Wa  found  that  tha  racommandations  givan 
by  tha  manufacturar  wara  incomplata  and  oftan  incorract.  In 
spita  of  this,  wa  faal  that  wa  hava  succassfully  axaminad  a 
nufflbar  of  kay  parformanca  charactari sties  of  tha  Loral  LCLV.  Tha 
rasults  of  thasa  maasuramants  hava  allowad  us  to  improva  tha 
parformanca  of  tha  Loral  LCLV. 

In  conclusion,  wa  would  racommand  using  tha  Hughas  davica 
for  two  raaaona.  First,  it  has  dramatically  suparior  writing 
sansitivity.  Sacondly,  its  raading  wavalangth  sansitivity 
matchaa  tha  wavalangth  amisaion  of  common  phosphors  usad  in  imaga 
intansifiars  and  CRTs. 
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Real-Time  Optical  Edge  Enhancement  Using  a  Hughes  Liquid 

Crystal  Light  Valve 


T?en-Hsin  Chao  and  Hua-Kuang  Liu 
Jet  Propulsion  Laboratory 
California  Institute  of  Technology 
Pasadena.  CA  91109 


Edge  enhancement  is  one  of  the  most  important  preprocessing  techniques  utilized  in  opti¬ 
cal  pattern  recognition.  In  an  optical  correlator,  cross-correlations  among  similar  input 
objects  can  be  greatly  reduced  by  using  the  edge  enhancement  technique.  Traditionally, 
optical  edge  enhancement  is  obtained  by  high-pass  filtering  at  the  Fourier  plane. 
However,  the  system  SNR  is  generally  lowered  by  this  filtering  process.  Recently,  two 
differentiating  spatial  light  modulators,  specifically  designed  to  generate  edge-enhanced 
output,  have  been  reported.  Casasent  et  al.  have  demonstrated  reaMfme  edge  enhance¬ 
ment  using  a  Priz  light  modulator  [IJ.  The  Priz  light  modulator  is  a  transverse  modification 
of  the  Pockel's  Read-out  Optical  Modulator  (PROM)  with  a  (ill]  BSO  crystal  cut.  Ar- 
mitage  and  Thackara  have  designed  a  BSO  photo-addressed  nematic  liquid  crystal  dif¬ 
ferentiating  spatial  light  modulator  (2.  3}.  A  layer  of  liquid  crystal  is  tuned  in  a  transverse 
configuration  (i.e.  the  electro-optic  response  Is  optimized  for  Ex  and  Ey  rather  than 
Ez )  to  achieve  the  edge-enhancement.  The  BSO  crystal  is  used  as  a  photo-addressing 
medium.  This  SLM  Is  functionally  opUmized  as  an  edge-enhancing  SLM. 

In  one  of  our  recent  artificial  neural  network  experiments,  we  discovered  an  Interesting 
edge  enhancement  effect  by  using  a  Cd-S  Hughes  Liquid  Crystal  Light  Valve. 

In  our  experiment,  the  edge-enhancing  effect  started  to  appear  as  the  biasing  frequency 
was  lowered.  This  effect  was  optimized  at  a  bias  frequency  of  500  Hz  and  voltage  of  6 

.  (For  normal  operation,  the  values  are  10  KHz  and  10  V^^g).  The  input  writing 

light  intensity  was  about  50  pw/cm2.  Experimentally,  a  linearly  polarized  read-out  beam 
was  employed.  First,  a  continuous  tone  image  was  obtained,  through  using  a  polarizing 
beam  splitter,  at  the  above  stated  biasing  condition.  The  edge-enhanced  output  was 
obtained  when  the  LCTV  was  rotated  about  30*  ccw. 
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The  interpretation  of  this  edge  enhancement  phenomenon  is  as  follows;  It  was  generally 
understood  that  in  a  photo-addressed  SLM.  the  transverse  field  components  are  propor¬ 
tional  to  the  spatial  gradient  of  the  writing  image.  Thus,  a  transverse  SLM  acts  as  a 
differentiating  or  edge-enhancing  device  [3].  As  a  low  frequency  biasing  signal  is  applied 
to  the  Hughes  LCLV,  the  liquid  crystal  molecules  align  themselves  along  the  direction  of 
the  applied  field  that  is  perpendicular  to  the  electrode  surfaces.  The  LCLV  is  thus 
switched  to  a  transverse  mode  under  this  bias  condition  and  functions  as  an  edge-en¬ 
hancing  spatial  light  modulator. 

The  experimental  results  are  shown  In  Rg,  1.  Rg.  1  (a)  shows  an  edge-enhanced  Air 
Force  resolution  chart.  Fig.  1  (b)  shows  an  edge-enhanced  picture  of  a  continuous-tone 
image.  In  this  picture,  the  outline  of  the  girl's  head  Is  clearly  displayed  and  the  halo  in  the 
background  is  reduced  to  a  ring. 

Further  experiments  using  this  real-time  edge-enhancing  effect  in  an  optical  correlator  are 
undenA^ay  at  JPL.  The  results  will  also  be  presented  in  the  meeting. 

The  research  reported  in  this  paper  was  performed  at  the  Jet  Propulsion  Laboratory. 
California  Institute  of  Technology,  as  part  of  Its  Innovative  Space  Technology  Center, 
which  is  sponsored  by  the  Strategic  Defense  Initiative  Organization/Innovative  Science  and 
Technology  through  an  agreement  with  the  National  Aeronautics  and  Space  Administration 
(NASA).  The  work  described  was  also  co-sponsored  by  NASA  OAST  and  the  Physics 
Division  of  the  Army  Research  Office. 
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(b) 


Rg.  1  Edge  enhancement  experiments  using  a  Hughes  Liquid  Crystal  Light  Valve. 

(a)  Edge-enhanced  image  of  an  Air  Force  resolution  chart,  (b)  Edge-enhanced 
image  of  a  continuous-tone  image. 
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Abstract 

This  paper  describes  how  the  standard  microchannet  spatial  light  modulator  can  be  (a)  operated 
and  (b)  modified  to  generate  a  real-time,  high-gamma  readout  characteristic.  The  paper  also 
e.xamincs  the  use  of  such  a  device  in  a  pulse-frequency  modulation  optical  processor  to  achieve 
a  wide  range  of  real-time,  nonlinear  image  and  signal  processing  operations  such  as  histogram 


measurement,  density  slicing,  density-based  artificial 
INTRODUCTION 

It  is  well  known  that  coding  and  modulation 
techniques  are  the  key  to  the  realization  of  a  large 
number  of  two-dimensional,  nonlinear  image  process¬ 
ing  operations.  The  commonly  used  techniques  in¬ 
clude  linear  modulation  of  an  image  using  Ronchi 
rulings^  or  sinusoidal  gratings,*  and  spatial  pulse- 
width  modulation  by  contact  Kreens.*  In  nonlinear 
processing,  operations  such  as  logarithmic  trans¬ 
formation,*"*  exponeniation,* ’*  level  slicing,*’* 
multiple  isophote  generation,*  '*  quantization,*  * 
pseudocolor,*  *  A-D  conversion,*  •*  *  subtraction,*  •*  * 
and  multiple  image  storage’  can  be  realized.  Other 
coding  and  modulation  techniques  include  optical 
pulse-frequency  modulation  and  pulse-azimuth 
modulation.*  *  A  one-dimensional  optical  pulse- 
frequency  modulation  technique,  for  example,  has 
been  used  in  conjunction  with  the  variable-grating- 
mode  liquid  crystal  light  valve**  to  demonstrate 
real-time  level  slicing. 

Unfortunately,  the  lack  of  a  high-resolution, 
high-gamma  spatial  light  modulator  that  would 
replace  photographic  film  has  precluded  widespread 
use  of  real-time  nonlinear  optical  processing.  The 
microchannel  spatial  light  modulator  (MSLM)*  *  '*  *  is 
a  device  that  is  capable  of  achieving  very  high 
gamma.  In '  this  paper  we  describe  how  the  standard 
MSLM  can  be  (a)  operated  and  (b)  modified  (Fabry- 

Perot  MSLM)  to  generate  a  real-time,  high-gamma 
readout  characteristic.  The  paper  also  examines  the 
use  of  such  a  device  in  a  pulse-frequency  modulation 
optical  processor  to  achieve  a  wide  range  of  real¬ 

time,  nonlinear  image  and  signal  processing  opera¬ 
tions  such  as  histogram  measurement,*  *  density 
slicing,**  density-based  artificial  stereo,**  and 
gray  level  image  enhancement.*  * 

HICH-CAMMA  CHARACTERISTIC 

The  desired  high-gamma  characteristic  for 
nonlinear  optical  processing  is  illustrated  in  Fig. 

I.  It  is  a  plot  of  log  l/T  vs  log  E^,,  and  it 

exhibits  a  sharp  threshold  exposure,  Ej)..  Here  T 
is  the  modulator  readout  transmittance  and  £„,  is  the 
modulator  input  exposure  with  a  threshold  of  E^^. 

For  this  negative-gamma  characteristic,  the  readout 
light  remains  in  the  ON  state  for  input  exposures 


stereo  and  gray  level  image  enhancement. 


below  threshold  and  is  switched  off  for  input  levels 
above  threshold.  The  gamma  y  of  the  system  is  the 
slope  of  the  linear  region  of  this  curve.  That  is, 
y  is  given  by 

y-  log(Tj/Tj)/log(Ej/Ej)  (1) 

Both  the  standard  and  the  Fabry-Perot  MSLMs  are 
capable  of  high-gamma  operation,  and  both  positive 
and  negative  gamma  characteristics  can  be  achieved. 

-  The  techniques  by  which  the  gamma  of  an  MSLM  can  be 
.  increased  include  (1)  operation  of  the  device  in  the 
.  nonlinear  hard-clipped  thresholding  mode,  (2) 

.  employing  optical  feedback  around  the  device,  and 

-  (3)  converting  the  device  to  a  Fabry-Perot  MSLM. 
—  The  Fabry  Perot  MSLM  inherently  generates  a  high- 
^  gamma  characteristic  when  operated  in  the  grid- 

stabilized  saturation  mode. 


Fig.  1.  Desired  high-gamma  characteristic. 


MICROCHANNEL  SPATIAL  LIGHT  MODULATORS 
Standard  MSLM 

The  standard  MicroChannel  Spatial  Light  Modula¬ 
tor  (MSLM)**'**  is  a  versatile,  real-tim:  optica! 
signal  and  image  processing  device  that  exhibits 
high  optical  sensitivity  and  high  framing  speed.  It 
consists  of  a  photocathodc,  a  microchannel  plate 
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(MCP),  a  planar  acceleration  grid  and  an  electro- 
optic  crystal  plate,  arranged  in  the  proximity 
focused  configuration  shown  in  Fig.  2.  The 
electro-optic  plate  carries  a  high  resistivity 
dielectric  mirror  on  one  side  and  a  transparent 
conducting  electrode  on  the  other. 


T  -  I,/Ij  -  sin*(r/2)  (4) 

The  most  recent  standard  MSLMs  have  employed 
LiNb03  as  the  electro-optic  crystal.  The  z-out 
crystal  has  been  used  for  phase  modulation  and  an 

oblique  cut  for  intensity  modulation.  Prototype 

devices  employing  SO-um-thick  oblique-cut  LiNbO, 

crystals  have  exhibited  spatial  resolution  of 

approximately  10  cycles/mm  at  50%  contrast.*  * 

Additionally,  the  internal  processing  operations 

achievable  with  the  standard  MSL.M  include  multiple- 
level  to  two-Isvel  intensity  image  transformation, 
contrast  reversal,  constrast  enhancement,  and  binary 

level  image  processing  operations  such  as,  AND, 
NAND,  OR.  NOR,  XOR,  NXOR.  However,  when  the 
standard  device  is  operated  in  the  linear  mode  its 
gamma  is  about  2.  and  this  value  is  too  low  for 
nonlinear  image  processing  applications  that  employ 

techniques  such  as  pulse  frequency  modulation. 

Further  details  of  the  principles  of  operation  of 
the  standard  MSLM  can  be  found  elsewhere.*  * 


Fig.  2.  The  optically  addressed  microchannel  spatial 
light  modulator 


In  the  electron  deposition  write  mode,  incoherent 
or  coherent  write  light  incident  on  the  photocathode 
creates  an  electron  image  which  is  amplified  by  the 
MCP  and  proximity  focused  onto  the  dielectric  mirror 
surface.  The  resulting  spatially  varying  electric 

field  in  the  crystal  modulates  the  refractive  index 
of  the  crystal.  Thus,  the  readout  tight  which  makes 

a  double  pass  through  the  crystal  is  spatially  phase 

or  amplitude  modulated  depending  on  the  crystal  cut 
and  readout  scheme  (polarization  or  interferometric) 
employed.  The  image  is  erased  by  appropriately 
adjusting  the  device  voltages  and  flooding  the 
photocathode  with  tight  so  that  electrons  are 
removed  from  the  mirror  surface  by  secondary 
electron  emission. 

Alternatively,  the  device  can  be  operated  in  the 
reverse  mode  where  a  positive-charge  image  is 

written  by  secondary  electron  emission  and  erased  by 
adding  electrons  to  the  crystal.  For  Pockets  effect 
crystals,  reversing  the  sign  of  the  image  surface 
charge  density  leads  to  contrast  reversed  images. 

In  the  linear  operating  mode,  the  incremental 
surface  charge  density  o(E)  deposited  on  the  crystal 
is  proportional  to  the  exposure  E. 


where  n  is  the  quantum  efficiency  of  the 
photocathode,  e  is  the  electronic  charge,  G  is  the 
gain  of  the  MCP,  h  is  Planck’s  constant  and  v  is  the 
frequency  of  the  write  light.  Additionally,  the 
induced  phase  change  A*  in  the  crystal  is 
proportional  to  a(E)  for  Pocket’s  effect  crystals. 
The  exact  expression  depends  on  the  type  and  cut  of 
the  crystal  employed.  For  example,  in  oblique-cut 
LiNbO, '  *  the  electrically-induced  phase  retardation 
r  is  of  the  form 


r 


Wy, 


S-OLU  fn* 
\  C  L"e 


(3) 


where  X  is  the  wavelength  of  the  exposing  light.  C 
is  the  capacitance  per  unit  area  of  the  crystal,  n^ 
and  n,  are  the  ordinary  and  extraordinary  refractive 
indices  respectively,  and  r->  and  r„>  arc  effective 
electro-optic  coefficients.  when  such  a  crystal  is 
read  out  between  crossed  polarizers,  the  trans¬ 
mittance  of  the  crystal  is  given  by 


Fabry-Perol  MSLM 


The  Fabry-Perot  version  of  the  MSLM  employs  a 

crystal  that  functions  as  an  electro-optically 

tunable,  Fabry-Perot  etalon  when  electrons  are 
deposited  or  removed  from  its  surface.  To 

fabricate  such  a  crystal  standard  dielectric  mirrors 
are  first  deposited  on  both  surfaces  of  the  crystal 
and  then  a  transparent  conducting  overcoat  is 
deposited  on  the  readout  surface  of  the  crystal. 
The  phase  change  4  which  results  from  the 

electrically  induced  refractive  index  change  An  is, 
to  a  good  approximation,  proportional  to  the  surface 
charge  density  o(E)  at  the  crystal  surface  and  to 
the  modulator  write  light  exposure  E_  [See  Eqs.  (2) 
and  (3)]. 

For  .  a  Fabry-Perot  etalon  with  surfaces  of 

■  reflectivity  R,  it  is  welt  known  that  the  ratio,  T, 
'  of  the  total  reflected  intensity  to  the  incident 
‘  intensity-  is  given  by 

4Rsin’(^ 

T  ..  I  /I.  -  - ; - (5) 

^  ‘  (1  -  W  +  4Rsio*(^ 

-  Shown  in  Fig.  3  is  a  plot  of  T  vs  ^  as  given  by  Eq. 

-  (S).  Note  that  the  reflected  readout  transmittance 

.  of  the  MSLM  approaches  zero  when  4  takes  on  integer 

-  multiples  of  2ir  radiana 


ON 


OFF 


Fig,  3.  Interferometric  readout  intensity  character¬ 
istic  of  a  Fabry-Perot  crystal  with  R  •  80  % 
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imigc  is  detected  in  the  plane  . 


Fig.  4. 

Optical 

feedback  configuration 

for 

high- 

gamma  operation  of  an  MSLM. 

In 

closed-loop 

operation,  for  a 

given 

fixed 

uniform 

exposure 

£g  incident  on  the 

input 

image 

transparency,  the  high  transmittance  regions  of  the 

input  image  will  at  first  result  in  strong  feedback 

'  to  the  photocathode.  This  will  quickly  result  in 

the  deposition  of  a  surface  charge  density  on  the 

crystal  so  as  to  drive  the  transmittance  of  the 
modulator  at  these  points  ’  to  zero  (stable 
~  equilibrium).  On  the  other  hand,  at  the  low 
transmittance  regions  of  the  input  image.  the 
feedback  will  be  weak.  This  will  result  in  low- 
values  of  £—  that  will  deposit  only  very  small 

amounts  of  additional  charge  on  the  crystal.  Since 
these  low  exposures  will  fall  below  the 

transmittance  of  the  modulator  will  remain  high. 

-  Because  the  MSLM  stores  these  charge  patterns,  this 

--  feedback  configuration  will  exhibit  the  high-gamma 

- characteristic  shown  in  Fig.  I  when  read  out  with  a 

'  ~  separate  uniform  source.  Thus,  an  input  image  is 
—  transformed  into  a  halftone  image  by  this  feedback 

-  configuration. 

- Preliminary  Results 

A  vacuum-demountable  Fabry-Perot  MSLM  was  con- 

-  structed  using  a  300-tim-thick  LiNbOj  crystal  with 
-  mirror  reflectivities  of  approximately  S0%  and  80% 

on  the  insulating  and  conducting  surfaces,  respect¬ 
ively.  The  insulating  mirror  consisted  of  a 
multiple  layer  dielectric  coating  of  Si02  and  Zr02. 
The  measured  readout  open-loop,  grid-controlled 
saturation  characteristic  of  the  device  is 
illustrated  in  Fig  5. 


Fabry-Perot  MSLM  With  Crid-Controllcd  Saturation 

Because  the  region  A-B-C  of  the  Fabry-Perot 
characteristic  (Fig.  3)  closely  approximates  the 
corresponding  region  of  the  desired  high-gamma 
characteristic  (Fig.  1),  the  Fabry-Perot  MSLM  will 
generate  the  high  gamma  characteristic  when  operated 
in  the  electron  deposition  mode  with  grid  stabilized 
saturation.  The  device  is  initially  started  at  the 
point  A  (ON  state)  by  precharging  the  crystal  with  a 
uniform  surface  charge  density  <r^.  This  is 

accomplished  by  flooding  the  photocathode  with  light 
and  setting  the  grid  voltage  to  a  value  such  that 

the  crystal  surface  saturates  at  the  corresponding 
surface  charge  density  Oq.  Then,  by  exposing  the 
photocathode  with  the  grid  voltage  set  at  V  the 
readout  light  follows  the  characteristic  in  Fig.  3 

until  the  crystal  surface  voltage  reaches  with  a 

corresponding  charge  density  of  o^.  Additional 

exposure  has  no  effect  on  the  readout  light  because 
of  grid-limited  surface  charge  accumulation.  Thus, 
the  high-gamma  characteristic  of  Fig.  I  is  achieved. 

Hard-Clipped  Thresholding  Mode 

Both  the  standard  and  the  Fabry-Perot  MSLMs  can 

be  operated  in  the  hard-clipped  thresholding  mode  to 
achieve  high  gamma  operation.  To  operate  an  MSLM  in 
the  hard-clipped  thresholding  mode  with  the 
negative-gamma  characteristic  shown  in  Fig.  I,  the 
device  is  initially  biased  in  the  ON  state  at  a  peak 

on  its  normal  (sin’r/2)  readout  characteristic. 

This  corresponds  to  the  point  A  on  Fig.  2.  Then, 
with  the  optical  input  image  incident  on  the 

photocathode,  is  ramped  downwards  at  a  pre¬ 
selected  rate  that  establishes  the  desired 

threshold  exposure  All  exposures  beiow 

will  be  barely  recorded  because,  at  their  locations, 
electrons  cannot  be  removed  fast  enough  from  the 
crystal  to  prevent  the  gap  field  from  eventually 
repelling  all  future  primary  electrons.  Thus,  all 

intensities  below  threshold  will  remain  in  the  ON 
state. 

Because  the  slope  of  the  resulting  characteristic 
is  very  steep  between  threshold  and  saturation, 
virtually  all  write  light  intensities  above  thres¬ 

hold  are  written  to  the  maximum  charge  density  which 
can  be  set  by  the  terminal  value  of  V|,  to  coincide 

with  the  point  C  (OFF  state)  on  the  device  readout 
characteristic.  Thus,  operation  in  the  nonlinear 
hard-clipped  thresholding  mode  leads  to  the  high- 
gamma  characteristic  of  Fig.  I.  Values  of  gamma  in 

excess  of  10  can  be  easily  achieved  with  both  the 
standard  and  Fabry-Perot  devices  using  this 
technique. 

Optical  Feedback  Configuration 

Both  the  standard  and  the  Fabry-Perot  MSLM  can  be 
operated  in  the  optical  feedback  configuration  shown 
in  Fig.  4  to  realize  high  gamma  operation.  The 
device  is  first  biased  at  the  point  A  on  its  readout 
characteristic.  As  before,  this  is  accomplished  by 
operating  the  device  in  the  open  loop  mode  (shutter 

S  closed),  flooding  the  phoiocathode  with  light  and 
adjusting  the  grid  voltage  such  that  the  crystal 
charges  to  the  uniform  surface  charge  density  o^. 
The  image  to  be  processed  is  then  placed  in  the 
input  plane  Pg  and  transferred  by  lens  Lg  ontu  the 
crystal.  The  resulting  modulated  readout  signal  is 
then  reimaged  via  the  feedback  path  onto  the 
photocathode  of  the  MSL.M.  The  processed  output 


Fig.  5.  Measured  open  loop  Fabry-Perot  readout 
characteristic  of  a  vacuum-demountable 

prototype  MSLM  with  crystal  surface 

reflectivities  of  50%  and  10%. 


277 


•> 


Note  the  improvement  over  the  typical  sine 
squared  characteristic  of  the  standard  MSLM 
Because  of  the  unmatched  reflectivities,  the 
contrast  of  the  measured  readout  characteristic  is 
not  optimum.  Nevertheless,  the  measured  open  loop 
gamma  of  this  prototype  Fabry-Perot  MSLM  is  6.2  as 
compared  with  a  gamma  of  2  for  the  standard  MSLM 
operated  in  the  linear  mode.  Closed  loop  gammas  are 
expected  to  be  much  higher. 

i 

I 

APPLICATIONS  TO  NONLINEAR  PROCESSING  j 

Pulsc-Frequency  Modulation  Technique 

The  goal  of  this  technique  is  to  perform  inten¬ 
sity  to  spatial  frequency  conversion  on  the  input 
image  so  that  subsequent  Fourier-plane  spatial 

filtering  results  in  the  desired  nonlinear  . 
operation.  The  coding  or  modulation  process  is  ! 
generally  performed  through  the  use  of  a  contact 
screen.  Contact  screens  consist  of  an  array  of 
cells  with  one-  or  two-dimensional  spatial-frequency  { 
and  transmittance  variations  T,g(x,y)  within  each  ; 
cell.* '  An  example  of  the  transmittance  profile  of 
a  specific  one-dimensional  contact  screen  is  shown  . 
in  Fig.  6.*  * 

Image  modulation  is  accomplished  by  sandwiching 


Fig.  7.  Standard  coherent  processing  system. 


To  further  illustrate  the  concept  of  pulse- 

frequency  modulation,  consider  the  specific  case  of 
a  one-dimensional  contact  screen  with  the  unit  cell 
transmittance  pattern  T,g(x)  that  is  illustrated  in 
Fig.  6.  The  unit  cell  of  this  screen  consists  of 
eight  slits  with  four  different  transmission  levels. 
Tji  -  T,^ .  Given  a  source  of  constant  uniform 
intensity  Ig,  it  follows  that  the  exposure  incident 
on  the  input  transparency  is  given  by  E.  >  1^  t. 
where  t  is  the  exposure  time.  Ignoring  diffraction 

losses,  the  exposure  Eg,  incident  on  the  high-gamma 
modulator  due  to  the  typical  slit  within  the  unit 
cell  will  be  given  by 

^mn  •  EoVsn:  “  “  >•  2.  3.  4,  (6) 


the  original  image  and  the  contact  screen  together 
and  imaging  the  combined  transparency  onto  a  high- 
gamma  (infinite  to  be  ideal)  recording  medium  such 
as  the  above-described  high-gamma  MSLMs.  The 
frequency  of  the  contact  screen  must  be  sufficiently 
high  so  that  within  a  unit  cell  the  transmittance 
Tp(x)  of  the  input  image  transparency  is  constant. 
Thus  upon  readout  of  the  high-gamma  recording  medium 
a  halftone  image  of  the  original  is  generated. 


Fig.  6.  Transmittance  profile  of  the  unit  cell  of  a 
specific  one-dimensional  contact  screen. 
Crossed-hatched  regions  are  opaque 

The  modulated  halftone  image  is  then  fed  into  the 
input  plane  of  a  coherent  optical  processor.  Fig.  7, 
which  separates  the  various  density  levels  into 

specific  spatial  frequency  domains  within  the 

Fourier  plane.  With  proper  design  of  the  screen, 
spatial  filtering  in  the  Fourier  plane  can  be 
effectively  utilized  to  achieve  a  wide  range  of 
nonlinear  image  and  signal  processing  operations. 


.  -  where  n  is  a  label  denoting  slits  of  the  same 
-  -  transmittance,  and  Tp,  the  local  transmittance  of 

-  -  the  input  image  transparency,  is  assumed  to  be 
-  constant  over  the  unit  cell.  Note  that  for  the 

-  •*''«»  E_g  >  E„,(  ) 

^ —  Because  the  moaulator  exhibits  the  threshold 

.  —  characteristic  illustrated  in  Fig.  I,  the  spatial 
frequency  modulation  of  its  readout  light  will  be 
- dependent  on  the  exposure  £_..  For  example,  given  a 

—  fixed  exposure  Eq  incident  on  the  input 
.  transparency,  if  within  a  given  cell  Tg  is  such  that 

: - Eg,4  <  E,|,,  then  all  Eg,-  for  that  cell  will  be  below 

- - threshold,  and  the  cml  will  have  a  uniform 

I - -  transmittance  of  nearly  unity.  Thus  the  modulator 

i  _  readout  light  from  that  cell  will  be  spatially 

!  - unmodulated.  That  is.  its  grating  carrier  spatial 

I  _  -  frequency  would  be  zero  (f-,  •  0).  Likewise,  if  Tp 
- is  such  that  Eg,4  t  E,),  >*kg,, ,  then  the  modulator 

_ _  readout  light  from  that  cell  w?!)  be  modulated  by  a 

_ grating  with  spatial  frequency  f„  »  1/X.  For  E  ,  i 

- E^j^  >  Eg,, ,  f j,  -  2/X,  _  and  Tor  Eg,,  2  E,j,,  - 

When  this  pulse-frequency  modulated  image  is 
.  injected  into  the  conventional  coherent  optical 

_ processor,  the  diffraction  spot  at  spatial  frequency 

_  coordinate  f,  •  fX/X  in  the  Fourier  plane  will 
contain  the  information  corresponding  to  points  in 
the  input  image  with  Tg  governed  by  T,^  Tg  i  •th '^o  * 
T,,  Tg.  Here  f  is  the  focal  length  of  the  Fourier 
transform  lens,  X  is  the  wavelength  of  the  readout 
source  and  I,),  and  Ig  are  the  intensities  corres¬ 
ponding  to  E,|,  and  Eg,  respectively.  Similarly,  the 
spot  at  fj,  a  fX2/X  contains  the  image  information 

corresponding  to  T„Tg  2  1,^/Ig  >  T,,Tg,  etc. 

Several  experiments  can  then  be  performed.  For 
example,  by  measuring  the  intensities  of  the  spots 
in  the  Fourier  plane,  a  histogram  of  the  original 
image  can  be  obtained.  Second,  if  different  neutral 
density  filters  that  have  higher  densities  for  the 

spectra  with  lower  intensities  are  placed  behind 
these  spots  and  all  other  diffraction  orders  are 
Slopped,  the  output  image  contrast  will  be  enhanced. 
Third,  if  a  white  light  readout  source  is  used 

instead  of  a  monchromatic  source,  and  a  set  of  color 
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filters  are  placed  at  the  Fourier  plane  to 

selectively  pass  certain  colors,  a  pseudo-cjlor 
image  will  be  obtained.  Finally,  if  a  set  of 
optical  wedges  with  different  wedge  angles  arc 

placed  behind  the  Fourier  plane  diffraction  spots, 
artificial  stereo  pictures  will  be  obtained.  These 
are  just  a  few  of  the  nonlinear  processing 
operations  that  can  be  realized  with  this  technique. 
These  experiments  are  now  in  progress.  Future 
results  will  be  published  elsewhere. 
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The  potential  of  the  esttemely  ineapenatve  Radio  Shack  lk|aid*cTyatal  televieioa  (LCTV)  as  a  tsro-dimensional 
spatial  light  modulator  has  bean  inveatigatad.  The  LCTV  i^ulataa  tbs  tranimiaaion  of  coherent  or  incoherent 
light  and  can  either  be  etoctfonkally  addreaaad  through  a  microcemputar  or  optically  addreaaad  with  a  TV  camera. 
We  have  measured  the  tranamiaaiOBcharactariaticaoftha  device,  eiamined  its  diffraction  pattern,  and  teated  its  use 
aa  an  input  device  for  an  optical  correlator.  We  have  diacovered  that,  with  proper  modifications,  it  has  potential  for 
optical-data-proceeaing  applicationt. 


It  is  well  known  that  optical  data  processing  and  opti¬ 
cal  computing  are  limited  mainly  ^  the  capability  and 
availabWty  of  real-time  devices,  such  as  two-dimen¬ 
sional  spatial  light  modulators  (SLM’s).  For  this  rea¬ 
son,  great  efforts  by  many  researchers  ^ve  been  spent 
in  search  for  usable  SLM’s.  Eiisting  and  developing 
SLM's  include  the  liquid-crystal  light  valve, ‘  the  mag¬ 
neto-optic  spatial  li|^t  modulator,^  the  microchannel 
spatial  light  modulator,^  the  Pockela  readout  optical 
modulator,^  and  the  deformable  mirror  device.* 

Many  SLM’s  are  either  forbiddingly  expensive  or 
are  still  in  R&D  stages.  Recently,  sev^  small  inex¬ 
pensive  compact  liquid-crystal  televisions  (LCTV’s) 
became  commercially  available.  We  have  investigat- 
ed  the  properties  of  the  Radio  Shack  IXTTV  for  opti- 
cal-data-proceasing  applications,  and  what  follows  is  a 
brief  account  of  our  diaooveriea. 

The  LCTV  has  a  5.4-cm  by  4.4-an  screen.  Theunit 
consists  of  a  two-dimensional  mosaic  of  raster- 
scanned  liquid-crystal  ceils,  each  of  which  is  capable 
modulating  the  coherent  or  incohment  light  transmit¬ 
ted  through  it  The  resolution  of  the  LCTV  is  deter¬ 
mined  by  the  number  of  cells  in  the  screen.  The 
LCTV  u^er  investigati<m  has  146  horisontal  ele¬ 
ments  by  120  vertical  eJements.  Each  unit  cell  is  370 
iim  X  370  Mm  square.  The  LCTV  is  equipped  with  a 
video  input  jack,  which  allows  an  image  to  be  written 
electroniotily  with  a  microcomputer  ot  optically  with  a 
TV  camera. 

For  most  of  our  experiments,  we  have  used  the  com¬ 
puter  input  mode.  When  an  Apple  11+  microcom¬ 
puter  is  used,  the  high-resolution  screen  with  280  hori¬ 
zontal  X  192  vertical  pixels  addresses  111  horizontal  X 
96  vertical  elements  the  LCTV.  Therefore,  there  is 
a  2  to  1  match  of  vertical  elements,  permitting  exact 
registration.  However,  the  horizont^  registration  is 
off,  causing  edge  blurring. 

A  TV  camera  was  also  used  to  provide  an  input 

0146-9692/86/120635-03t2.00/0 


scene,  and  gray-scale  operation  was  verified  by  chang¬ 
ing  the  /-stop  on  the  camera. 

Each  liquid-crystal  cell  of  the  TV  screen  is  a  90” 
twisted  nematic  liquid  crystal  sandwiched  between 
parallel  polarizers.  When  no  electric  field  is  applied, 
the  plane  of  polarization  for  linearly  polarized  light  is 
rotated  through  90”  by  the  twisted  liquid-crystal  mol¬ 
ecules,  and  no  light  is  transmitted  through  ^e  second 
polarizer. 

However,  under  an  applied  electric  field,  the  twist 
and  the  tilt  of  the  liquid-crystal  molecules  are  altered, 
resulting  in  a  greater  fraction  of  the  light  retaining  the 
initial  polarization  direction.  As  the  electric  field  is 
increased  further,  the  molecules  do  not  affect  the 
plane  of  polarization,  and  all  the  light  passes  through 
tte  secoi^  polarizer.  Transmission  losses  are  then 
limited  to  the  transmission  of  two  polarizer  sheets. 

Voltage  is  applied  to  each  pixel  through  horizontal 
and  vertical  line  electrodes,  which  intersect  at  each 
pixeL  The  voltage  applied  to  each  pixel  is  determined 
by  two  factors.  First,  a  brightness  control  determines 
a  bias  voltage  across  every  cell  that  allows  the  trans- 
misaion  level  of  the  entire  screen  to  be  varied.  The 
input  signal  from  the  TV  receiver,  the  computer,  or 
the  TV  camera  then  varies  the  individual  voltage  ap¬ 
plied  to  each  cell  modulating  the  individual  transmis¬ 
sion  of  each  cell,  thus  creating  a  SLM  with  gray-scale 
capability. 

We  have  performed  a  series  of  experiments  on  the 
LCTV.  Measurements  have  been  nuKle  of  the  optical 
transmission  at  the  He-Ne  laser  wavelength  as  a  func- 
tk»  of  bira  voltage  acroas  the  liquid-crystal  unit  cells. 
Control  of  this  voltage  is  provided  by  the  brightness 
adjusti^tootheLCTV.  In  order  to  obtain  a  quanti¬ 
tative  measurement,  we  took  the  LCTV  ap^  and 
measured  the  voltage  drop  acroM  the  variable  resistor 
controlled  by  the  brightness  control  (The  voltage 
acroas  a  cell  is  not  directly  accessible.)  The  laser 
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Fig.  1.  Transmission  measurements  of  the  LCTV  asafunc- 
tion  of  bias  voltage.  C urve  A  shows  results  with  the  comput¬ 
er  pixels  turned  off;  curve  B  shows  results  with  the  computer 
pixels  turned  on. 


beam  was  expanded  to  cover  a  l-cm^  area  of  the  LCTV 
screen  to  average  over  a  large  number  of  pixeia.  The 
percentage  transmission  versus  voltage  is  shoem  as 
curve  A  of  Fig.  1.  The  maximum  transmission  obtain¬ 
able  is  50%,  and  the  full  contrast  is  about  25/1. 

Next,  the  transmission  was  measured  as  the  com¬ 
puter  wrote  uniformly  on  the  LCTV.  The  computer 
output  places  an  additional  voltage  on  each  cell,  mod¬ 
ulating  its  transmisaion  erith  results  shown  as  curve  B 
of  Fig.  1.  The  computer  voltage  has  the  effect  of 
shifting  curve  A  by  about  -0.4  V.  Therefore  the  oper¬ 
ation  of  the  LCTV  using  a  computer  input  consists  of 
picking  a  bias  point,  using  the  brightness  control,  and 
then  having  the  computer  change  the  bias  voltage  and 
the  resulting  transmission  at  any  pixel. 

Maximum  contrast  is  obtained  by  biasing  the 
brightness  control  at  -0.4  V.  The  high  slope  of  the 
transmission-versus-voltage  curve  ensures  that  the 
computer  will  cause  a  maximum  change  in  transmis¬ 
sion.  In  many  SLM  applications,  it  is  important  to 
turn  all  unused  unit  cells  off,  and  the  preferred  bias 
point  is  at  -1.2  V.  However,  when  the  pixels  are 
turned  on,  the  transmission  increases  only  to  5%.  with 
the  contrast  significantly  decreased.  Tito  change  in 
the  voltage  applied  to  e^  unit  cell  is  set  by  the  TV 
circuitry.  Attempts  to  increase  this  voltage  awing  for 
higher  contrast  were  unsuccoasfiiL  These  included 
varying  the  video  gain  and  the  analog-to-digital  con¬ 
verter  adjustment  inside  the  TV  and  externally  ampli¬ 
fying  the  rf  signal  from  the  computer.  Tterefwe, 
without  extensive  modification,  cmnputer  operation 
of  the  LCTV  can  provide  only  minimal  binary  trans¬ 
mission. 

Measurements  also  have  been  made  of  the  Fraun¬ 
hofer  diffraction  pattern  for  light  incident  upon  the 
LCTV;  they  are  shosm  in  Fig.  2(a).  As  expect  from 
theoretical  predictions,  the  prominent  pattern  is  rep¬ 
resentative  of  the  grid-matrix  type  of  cell  structure  of 
the  LCTV  elements.  Figure  2(b)  shows  the  results 
when  a  horixontal  grating  is  written  on  Use  LCTV 
screen  with  every  other  liiM  turned  on.  The  expected 
additional  direction  spots  are  clearly  visible. 

Finally,  series  of  measurements  ^ve  been  made 
usi^  the  LCTV  as  the  input  screen  for  a  Vawkr  Lugt 
opti^  correlator.*  The  correlation  system  geometry 
is  shown  in  Fig.  3.  Collimated  light  from  a  spatially 
filtered  beam  is  incident  upon  plane  Pi,  wlwte  the 


input  pattern  is  placed  using  the  LCTV.  The  Fourier 
transform  plane  P2  is  obtained  using  a  75-cm  focal- 
length  lens.  The  reference  beam  was  also  spatially  1 
filtered  and  collimated  and  then  focused  using  a  long- 
focal-length  lens  to  plane  Pi  located  beyond  plane  P^. 

This  convergi^  reference  beam  is  used  to  eliminate  | 
the  final  Fourier-transform  lens.'  *  Matched  spatial  <  : 
filters  (MSF’s)  were  recorded  using  a  Newport  Corpo¬ 
ration  Model  HC-300  thermoplastic  recording  camera.  > 

The  focused  reference  beam  synthesizes  a  Fresnel 
zone  plate  within  the  MSF.  Care  was  taken  in  record¬ 
ing  t^  MSF  to  emphasize  the  spatial  frequencies  cor- 
reqxmding  to  the  pating  information  shown  in  Fig.  2(b)  . 

and  not  the  grid  information  shown  in  Fig.  2(a).  The  t 
MSF  was  m^e  using  a  computer-generated  Ronchi 
ruling  having  a  peric^  of  10  pixel  lines  on  the  high- 
resolution  computer  screen.  I 

Plane  Pa  contains  the  correlation  between  the  input  I 
pattern  and  the  pattern  used  in  the  recording  of  the 
MSF.  When  different  computer-generated  Ronchi 
ruling  patterns  appeared  on  the  LCTV,  the  correlation 
spikes  were  measured  using  a  diode  array;  results  are 
shown  in  Fig.  4.  Figure  4(a)  shows  the  output  when 
the  input  Ronchi  ruling  pattern  is  identicd  to  that 
used  in  making  the  MSF.  The  correlation  spike  is  j 
clearly  seen.  Figure  4(b)  shows  the  results  when  a 
computer-generated  Ronchi  rxiling  pattern  having  a 
period  of  24  lines  was  fed  to  the  LCTV.  The  correla-  : 
tion  spike  is  reduced,  as  expected.  < 

The  size  of  the  correlation  spike  decreased  as  the 
period  of  the  input  ruling  varied  about  the  period  used 


(o)  (b) 


Fig.  2.  Fraunhofer  diffraction  patterns  from  the  LCTV: 
(a)  without  (b)  with  a  horizontal  grating  written  onto  the 
screen. 


284 


December  1985  \'ol.  10.  \'o  i:  OPTICS  LETTERS  637 


(Ci 


Fig.  4.  Crou-correlation  aignala  due  to  a  MSF  of  a  10-line 
ruling  pattern  on  the  LCTV  screen  addressed  by  (a)  10  tines, 
(b)  24  linea,  (c)  a  blank  screen.  The  vertical  axes  are  of  the 
same  scale  with  arbitrary  units.  The  horizontal  axis  hat  a 
total  width  of  3.2  mm  ( >  128  Mm  x  25  Mm). 


in  making  the  MSF.  Our  success  in  optimizing  the 
MSF  is  shown  in  Fig.  4(c),  with  the  LCTV  screen 
uniformly  transparent  where  the  correlation  spike  is 
almost  gone.  If  the  MSF  were  optimized  for  the  spa¬ 
tial  frequencies  corresponding  to  the  two-dimensional 
grid  information  rather  than  to  the  ruling  information, 
the  spike  would  still  have  been  evident. 

In  conclusion,  our  experiments  show  that  the  LCTV 
can  be  used  as  a  SLM.  It  allows  data  to  be  input  easily 
to  the  LCTV  screen  from  either  a  microcomputer  or  a 
TV  camera.  The  contrast  is  good  when  the  brightness 
control  is  adjusted  to  midrange.  However,  if  mini¬ 
mum  transmission  is  desired  for  various  unit  cells, 
then  the  maximum  transmission  is  limited  to  about 
5%.  lliis  transmission  characteristic  compares  well 
with  that  of  the  Litton  magneto-optical  SLM^  and 
should  be  improvable  with  changes  in  the  internal 
electronic  circuits  of  the  LCTV. 

At  the  present  stage,  only  relatively  coarse  objects 
can  be  used  as  inputs  for  a  r^-time  correlator  because 


of  limitations  in  the  resolution  and  space-bandwidth 
product  of  the  LCTV.  Nevertheless,  TV  frame-rate 
correlation  on  an  input  image  at  a  fixed  location  can  be 
implemented.  No  shift  invariance  was  observed.  This 
is  due  to  phase  nonuniformity  of  the  LCTV,  which  was 
discovert  by  us  working  with  Psaltis’s  group  at  the 
California  Institute  of  Technology  campus  and  also 
pointed  out  by  one  of  the  reviewers  of  the  manuscript 
of  this  Letter.  However,  the  LCTV  correlator,  after 
further  improvements  and  modifications,  should  be 
useful  to  robotic  vision  and  space  automation  pro¬ 
grams  at  NASA  and  in  industry.  It  is  also  worthwhile 
mentioning  that  the  low  price  and  versatility  of  the 
LCTV  SLM  make  it  attractive  for  optical-image-pro- 
cessing  pedagogical  applications. 

We  are  currently  investigating  other  applications 
for  this  LCTV,  including  bipolar  modulation,^  optical 
subtraction,^^  high-gamma  nonlinear-optical  image 
processing,  and  opti^  division  applications. 

The  research  described  in  this  Letter  was  sponsored 
by  the  Physics  Division  of  the  U.S.  Army  Research 
(Office  and  the  National  Aeronautics  and  Space  Ad¬ 
ministration.  The  LCTV  was  first  called  to  the  atten¬ 
tion  of  one  of  us  (H.  K.  Liu)  by  J.  G.  Duthie.  We  thank 
M.  Brownell  and  P.  Dickinson  for  assisting  in  some  of 
the  measurements  and  M.  Hatay  for  helping  to  disas¬ 
semble  the  LCTV. 
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ABSTRACT 


The  principle  of  operation  of  the  liquid  crystal  television 
(LCTV)  spatial  light  modulator (SIM)  and  the  SLM  properties  of  a 
new  hlgh-resolution  research  module  LCTV  will  be  discussed.  A 
comparison  of  this  module  with  the  Radio  Shack  and  Epson  LCTV 
SLMs  will  be  made. 
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On  the  Progress  of  the  Liquid  Crystal  Television 
Spatial  Light  Modulator 


Hua-Kuang  Liu  and  Tien-Hsin  Chao 
Jet  Propulsion  Laboratory 
California  Institute  of  Technology 
Pasadena,  California  91109 


The  pocket-sized  liquid  crystal  televisions  recently  marketed 
by  several  Japanese  companies  have  been  welcome  gifts  among 
friends  and  found  useful  in  applications  such  as  the  view-finders 
in  video  cameras.  Many  optical  processing  researchers  have 
also  begun  to  use  these  devices  as  a  spatial  light  modulators 
(SLM's)  in  a  variety  of  ways.  It  has  been  demonstrated  that 
* LCTV's  can  be  used  as  optical  input  devices,  logic  elements, 
computer  generated  hologram  recordings,  and  2-D  phase  image 
representations.  The  LCTV  may  be  used  for  these  processing 
applications  because  it  has  several  attractive  features.  For 
example,  it  is  electronically  addressable  through  a  micro¬ 
computer,  and  since  it  is  a  TV  by  design,  it  is  naturally 
addressable  by  a  TV  camera  and  it  can  be  refreshed  at  a  speed  of 
30  Hz.  By  definition,  when  the  LCTV  is  used  as  a  SLM,  it  can  be 
controlled  remotely  by  an  emitting  antenna  anywhere  in  the  world. 
So  one  can  imagine  that  a  joint  experiment  on  optical  processing 
could  be  performed  by  researchers  from  Asia,  Europe,  and  the 
United  States  through  the  TV  transmitter  and  receiver  linkage. 
The  speed  of  30  frames/ sec.  is  sufficient  for  the  present  usage 
because  the  inputting  of  image  signals  from  a  computer  can  hardly 
exceed  this  speed. 

The  purpose  of  this  paper  is  to  give  a  review  of  the  principle  of 
operation  of  the  LCTV  SI2!,  to  present  the  recent  findings  of  the 
spatial  light  modulation  properties  of  a  high-resolution  research 
module  LCTV,  and  to  make  a  comparison  of  this  module  and  the 
Radio  Shack,  and  the  Epson  modules. 

The  basic  structure  of  a  twisted  nematic  cell  is  shown  in  Figure 
1.  The  liquid  crystal  molecules  are  sandwiched  between  two  layers 
of  transparent  electrodes^.  An  electric  field  can  be  applied 
between  these  electrodes.  In  Figure  1(a) ,  it  is  shown  that  when 
the  two  polarizers  are  in  parallel,  due  to  the  rotation  of  the 
polarization  of  the  light  through  the  cell,  the  output  is  darx 
when  the  addressing  voltage  is  off.  The  output  is  bright  when  the 
addressing  voltage  is  on.  The  opposite  is  true  when  the 
polarizers  are  orthogonal  as  shown  in  Figure  1(b).  In  the  TV 
operation,  to  gain  speed,  the  rotation  is  much  less  than  90 
degrees  and  therefore  the  contrast  is  reduced.  Recently,  thin 
film  transistors (TFT)  have  been  built  into  the  LC  cells  as  shown 
in  Figure  2.  The  function  of  these  TFT's  is  to  hold  the 
addressing  voltage  and  thus  to  prevent  the  loss  of  contrast  due 
to  the  voltage  relaxation  effect^.  The  Epson  LCTV  has  TFT's  in 
the  cells. 
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Ordinary  LCTV's  that  are  commercially  available  have  a  total 
number  of  pixels  of  not  over  20^000  and  a  pixel  size  of  not  less 
than  300  by  300  square  micrometers.  The  characteristics  of  these 
types  of  LCTV  SLM  have  been  reported  during  the  past  couple  of 
years  in  the  literature.  Recently,  we  have  experimented  with  a 
research-type  LCTV  SLM  that  is  not  yet  commercially  available. 
This  LCTV  has  a  screen  dimension  of  21.56mm  x  28.512mm  having  220 
X  648  total  pixels.  However,  since  it  is  designed  for  color  TV, 
the  number  of  effective  pixels  equals  one  third  of  the  total  to 
account  for  the  three  primary  colors.  For  our  test,  the  color 
filters  in  the  screen  have  been  removed  to  achieve  black-and- 
white  transmission.  Under  this  condition,  the  LCTV  still  has  a 
spatial  resolution  that  is  about  an  order  of  magnitude  higher 
than  the  existing  models  on  the  market. 

After  proper  correction  of  the  non-viniformity  of  the  aperture, 
due  to  the  uneven  structure  of  the  multiple-layer  TV  screen,  we 
measured  the  Fourier  transform  of  the  high-resolution  LCTV  and 
recorded  the  result  which  is  shown  in  Figure  3(a).  For 
comparison,  a  similar  result  of  that  of  a  previous  Radio  Shack 
LCTV  SLM  is  shown  in  Figure  3(b). 

To  see  the  other  characteristics  of  this  high-resolution  LCTV,  we 
have  also  measured  the  angular  rotation  of  the  liquid  crystal 
molecules  as  well  as  the  corresponding  light  transmission  and 
contrast  ratios  as  a  function  of  the  bias  voltage  of  the  TV.  The 
contrast  versus  bias  voltage  is  shown  in  Figure  4.  As  it  can  be 
seen,  when  the  bias  voltage  is  14  volts,  the  maximum  contrast 
ratio  is  only  about  6:1.  The  poor  contrast  is  probably  due  to 
two  reasons.  One  is  that  in  order  to  maintain  the  30  Hz  TV  frame 
rate,  the  maximum  angle  of  rotation  of  the  nematic  liquid 
crystals  must  be  relatively  reduced  to  cover  the  increased  number 
of  pixels.  In  addition,  we  have  found  that  the  laser  beam 
becomes  elliptically  polarized  after  it  passes  through  the  liquid 
crystal  with  a  biased  voltage  as  high  as  14  volts.  This  could 
cause  a  reduction  of  the  contrast. 

To  those  who  question  the  value  of  this  device  because  of  its  low 
cost,  we  would  respond  as  follows:  If  we  counted  all  the 
development  cost  that  the  display  community  has  invested  in  this 
device,  the  cost  of  each  unit  of  the  LCTV  would  probably  be  much 
higher  than  any  of  the  other  existing  SIH's  on  the  market  today. 
An  example  is  the  research  module  under  test  in  our  laboratory; 
it  was  extremely  expensive  to  develop,  furthermore,  a  significant 
improvement  can  be  made  on  this  device  with  regard  to  both 
contrast  and  speed.  An  LCTV  with  contrast  ratio  of  over  100, 
operating  at  TV  frame  rate  and  of  high  resolution  is  being 
developed  in  Japan.  However,  if  we  hope  that  the  LCTV's  will 
serve  as  SLM's  operating  according  to  optical  processing 
specifications,  intensive  research  work  in  this  area  should  be 
encouraged.  For  example,  the  following  additional  specifications 
are  desired:  light  throughput  of  more  than  25%;  operating 
wavelength  of  0.6  to  1.3  micrometers;  and  an  overall  flatness  of 
within  0.1  wavelength  over  the  aperture  and  writing  speed  of  lOO 
sec“^.  These  goals  seem  within  reach  if  reasonable  development 
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efforts  can  be  devoted  to  them. 

To  present  an  overview  of  the  latest  progress  on  the  LCTV  SLM's, 
we  have  sununarized  the  characteristics  of  the  Radio  Shack,  the 
Epson,  and  the  high-resolution  module  LCTV  SLM  and  listed  the 
data  in  a  Table  of  Comparison.  This  Table  will  be  presented  in 
the  meeting. 

The  authors  would  like  to  thank  Shigeru  Morokawa  for  providing 
JPL  with  the  experimental  LCTV  modules  and  for  many  helpful 
discussions.  The  research  reported  in  this  paper  was  performed  at 
the  Jet  Propulsion  Laboratory,  California  Institute  of 
Technology,  as  part  of  its  Innovative  Space  Technology  Center, 
which  is  sponsored  by  the  Strategic  Defense  Initiative 
Organization/Innovative  Science  and  Technology  through  an 
agreement  with  the  National  Aeronautics  and  Space  Administration 
(NASA)  .  The  work  described  was  also  co-sponsored  by  NASA  OAST 
and  the  Physics  Division  of  the  Army  Research  Office. 
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Figure  1.  The  basic  structure  and  operating  conditions  of  a 

twisted  nematic  liquid  crystal  cell. 
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Figure  2.  Thin  film  transistor  (TFT)  controlled  twisted 

nematic  crystal  arrays. 


Cb) 

Figure  3.  (a)  Fourier  spectrum  of  a  research-module  high 

resolution  LCTV.  (b)  Fourier  spectrum  of  a 
Radio  Shack  LCTV. 
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Contrast  ratio  versus  bias  voltage  of  a  research 
module  high-resolution  LCTV 


Figure  4. 
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A  novel  use  of  liquid-crystal  television  (LCTV)  is  described.  It  is  shown  that,  if  the  phase  nonuniformity  of  the 
LCTV  is  corrected  by  a  liquid  gate,  then  a  simple  computer-generated  hologram  can  be  srritten  and  coherently 
reconstructed. 


It  ia  w«ll  known  that  spatial  light  modulators  (SLM’s) 
ar«  essential  for  real-time  optical  information  process¬ 
ing.  For  that  reason,  much  research  has  been  devoted 
to  them,  and  many  types  of  SLM  have  been  devel¬ 
oped.* 

Most  of  the  existing  SLM’s  are  either  forbiddingly 
expensive  or  still  in  the  research  and  development 
stages.  Recently  an  extremely  inexpensive  Uquid- 
crystal  television  (LCTV)  was  investigated  in  relation 
to  its  use  in  optical  data  proceesing.^***  One  advan¬ 
tage  of  the  LCTV  is  that  it  can  be  addressed  either 
electronically  or  optically.  However,  because  of  the 
thickness  variations  over  the  aperture  of  the  screen  of 
the  devices,  its  usefulneu  for  coherent  optical  process¬ 
ing  is  limited. 

We  have  examined  the  thickness  nonuniformities  of 
the  L(3TV  screen  in  a  Mach-Zehnder  interferometer. 
We  have  successfully  corrected  the  nonuniformities  by 
submerging  the  screen  in  a  liquid  gate  and  have  dem¬ 
onstrated  the  feasibility  of  using  this  device  to  write 
and  reconstruct  a  computer-generated  hologram. 
The  results  are  briefly  reported  below. 

The  operating  principle  of  the  LCTV  has  been  de¬ 
scribed.^-^  The  device  has  a  5.4  cm  by  4.4  cm  screen 
that  consists  of  a  two-dimensional  mosaic  of  individ¬ 
ually  addressable  liquid-crystal  cells  that  contain  a  90- 
deg  twisted  nematic  liquid  crystal  sandwiched  be¬ 
tween  two  glass  plates.  These  plates  have,  respective¬ 
ly,  transparent  horizontal-line  and  vertiori-line  elec¬ 
trodes  deposited  on  their  inner  surfaces  facing  the 
liquid  crystal.  Two  linear  polarizer  sheets  (polariz¬ 
ers)  are  glued  to  the  outer  surfaces  of  the  glass  plates. 
The  polarization  axes  of  these  polarizers  are  parallel. 


When  no  electric  field  is  applied,  the  plane  of  polariza¬ 
tion  for  linearly  pobrized  light  is  rotated  through  90 
deg  by  the  twisted  liquid-crystal  molecules,  and  nc 
light  is  transmitted  through  the  second  polarizer. 
However,  with  an  electric  Held  applied,  the  twist  and 
tilt  of  the  liquid-crystal  molecules  are  altered,  result¬ 
ing  in  transmission  of  a  controllable  and  varwble  frac¬ 
tion  of  light.  The  input  signal  to  the  LCTV  can  be 
&om  a  TV  receiver,  a  computer,  or  a  TV  camera. 

A  Mach-Zehnder  interferometer  was  set  up  to  ana¬ 
lyze  the  optical  quality  of  the  LCTV  screen.  A  6.4- 
cm^  (1-in.^)  region  of  the  LCTV  screen  was  illuminat¬ 
ed  by  a  collimated  He-Ne  laser  beam.  The  results  are 
shown  in  Fig.  1(a).  It  can  be  seen  that  more  than  five 
fringes  are  produced,  indicating  thickness  nonunifor¬ 
mities  of  the  LCTV  screen  amounting  to  about  0.046 
Aim  per  pixel.  It  has  been  found  that  the  phase  non¬ 
uniformity  is  due  mainly  to  the  poor  quality  of  the 
polarizer  sheets.  Because  of  the  nonuniformity, 
Fraunhirfer  diffraction  patterns  show  fuzziness  in  the 
various  orders.^ 

We  investigated  two  ways  of  removing  the  phase 
distortions.  The  flrst  was  to  correct  the  phase  varia¬ 
tion  by  a  phase-conjugation  method.  We  used  a  10- 
m  W  He-Ne  laser  to  pi^uce  a  holographic  filter  of  the 
LCTV  screen  and  addressed  it  with  a  phase-conjugat¬ 
ed  beam  projected  through  a  holographic  plate.  Un¬ 
fortunately,  the  beam  reconstructed  through  the 
LCTV  was  too  weak  to  be  observed  visually  because  of 
the  low  diffraction  efficiency  of  the  hologram  and  the 
low  power  of  the  laser.  The  effectiveness  of  the  phase- 
conjugation  technique  was,  therefore,  not  conclusively 
shown.  However,  Casasent  and  Xia  have  proved  that 
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this  is  a  viable  way  of  correcting  the  phase-nonunifor¬ 
mity  problem.' 

We  then  used  a  liquid-gate  correction  technique. 
The  LCTV  screen  was  submerged  in  a  liquid  gate 
(NRC  Model  550)  filled  with  an  index-matching  non- 
conductive  mineral  oil  with  a  refractive  index  of  about 
1.45.  In  this  case,  the  optical  path  length  through  the 
liquid  gate  was  made  nearly  constant.  Because  it  is 
hard  to  match  simultaneously  the  different  indices  of 
the  LCTV  screen  (glass  plates  plus  polarixers),  a  small 
amount  of  phase  variation  remained.  Neverthelesa, 
we  have  found  that  moat  of  the  thickness  variation  of 
the  TV  screen  was  corrected.  Figipe  1(b)  shows  an 
interferogram  of  the  liquid  gate  without  the  LCTV 
screen.  Note  that  much  leas  than  one  fringe  appears 
across  the  illuminated  region  when  the  liquid  gate 
(filled  with  mineral  oil)  is  placed  in  the  path  of  the 
Mach-Zehnder  interferometer. 

Figure  1(c)  is  an  interferogram  of  the  LCTV  screen 
submerged  in  the  same  liquid  gate. 


(c) 

Fig.  1.  Phase-nonunifomity  coriectioa  of  the  ICTV  in  a 
Mach-Zehader  iateiferoaster  (MZI)  as  shown  by  (a)  n 
interfbrogram  with  LCTV  in  a  MZL  (b)  an  interferogram 
with  liquid-nUod  liquid  gats  in  a  MZL  and  (c)  an  interfsro- 
gran  with  LCTV  submerged  in  liquid  gate  in  a  MZI. 


With  tlm  I^UM  distortion  of  the  LCTV  inoa^  cor¬ 
rected,  sevwal  coherent-optical  data-procaaaing  ex- 
ptriwen*e  can  be  ptoCwmed,  including  an  optical 
matchad-fUtming  eiperinient.^’  We  tho^t  it  inter¬ 
esting  to  try  to  write  a  computer-generat^  hologram 
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on  the  LCTV  and  reconstruct  it  through  coherent 
light.  A  100  X  100  pixel  binary  phase  kinofonn^^  of  a 
circle  was  first  generated  using  an  IBM  PC  computer. 
Figure  2(a)  shows  the  kinoform  displayed  on  a  conven¬ 
tional  TV  monitor.  The  kinoform  was  produced  by 
binary  encoding  of  the  phase,  while  the  amplitude  was 
kept  constant,  at  each  pixel  of  the  Fourier  transform  of 
a  circle.  Basically,  this  kinoform  consisted  of  on-axis, 
phase-modulated  patterns  written  into  the  liquid- 
crystal  layer  through  the  electrodes  controlled  by  the 
computer  output.  When  the  collimated  laser  light 
was  transmitt^  through  the  liquid-crystal  layer,  the 
phase  ofthe  light  was  modulated.  The  output  analyx- 
er-polarizer  served  the  function  of  transforming  the 
phase  variations  into  amplitude  variations.  However, 
only  the  vertical  resolution  of  the  kinoform  matched 
that  of  the  LCTV  exactly.  The  LCTV  interpolated 
the  missing  horizontal  points  to  form  an  image  as 
shown  in  Fig.  2(b). 

The  LCTV,  submer^  in  the  oil-filled  NRC  liquid 
gate,  was  then  placed  in  an  optical  Fourier-transform 
system.  The  resulting  holo^aphic  reconstruction  of 
the  circle  is  shown  in  Fig.  2(c).  As  expected,  the  ellip¬ 
tical  appearance  of  the  circle  is  due  to  the  nonunity 
aspect  ratio  of  the  high-reaolution  format  of  the  IBM 
PC.  A  zero-order  dc  spot  has  been  blocked  for  clearer 
image  presentation.  The  high-intensity  dc  spot  not 
shown  here  is  believed  to  be  caused  by  the  noncon¬ 
stant  rotations  of  polarization  of  the  pixels  of  the  same 
logic  level 

To  show  the  necessity  of  using  the  Uquid  gate  in  the 
present  work,  we  also  recorded  a  bini^  phase  holo¬ 
gram  of  the  letter  0  on  a  piece  of  film  and  placed  it  in 
front  of  the  LCTTV  screen  with  the  TV  electronics 
turned  off.  The  rectmstruction  of  this  composite  fil¬ 
ter  was  fuzzy.  After  the  LCTV  was  removed,  the 
reconstruction  became  well  defined.  Hence  we  may 
conclude  that  the  unimproved  LCTV  can  introduce 
enough  phase  distortion  to  cause  fsilure  in  reconstruc¬ 
tion. 

The  results  described  in  this  Letter  demonstrate  the 
usefulness  of  an  inexpensive  LCTV  as  a  spatial  light 
modulator  for  coherent-optical  processing  in  the  w^- 
ing  ami  reconstruction  (rf  a  single  computer-generated 
hologram-  Some  similar  reralts  were  achieved  by 


Psaltis  et  al.,  who  used  a  magneto-optics  device  for 
reconstruction  of  a  hologram.'^  These  findings 
should  make  it  much  easier  and  less  expensive  for 
many  optics  laboratories  to  conduct  experiments  on 
coherent  and  incoherent  optical  processing. 

We  are  currently  investigating  the  use  of  a  large- 
memory  correlators^  with  the  LCTV  as  a  real-time 
incoherent-to-coherent  transducer  and  with  its  zero 
order  suppressed. 

The  research  described  in  this  Letter  was  carried 
out  by  the  Jet  Propulsion  Laboratory,  California  Insti¬ 
tute  of  Technology,  and  was  sponsored  by  the  Physics 
Division  of  the  U.S.  Army  Research  Office  and  the 
National  Aeronautics  and  Space  Administration. 

We  would  like  to  thank  J.  W.  Goodman  of  Stanford 
University  and  A.  Johnston  of  Jet  Propulsion  Labora¬ 
tory  for  hslpfiil  discussion  on  the  use  of  liquid  in  the 
liquid  gate. 

J.  Diep  is  an  academic  part-time  employee  at  Jet 
Propulsion  Laboratory,  C^omia  Institute  of  Tech¬ 
nology. 
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Abstract.  A  real-time  broadband  pseudocolor  image  enhancement  technique 
using  a  liquid  crystal  television  spatial  light  modulator  (LCTV  SLM)  is  described. 
Three  different  schemes  to  modulate  the  gray-scale  distribution  of  an  input 
scene  by  an  LCTV  SLM  through  varying  the  orientations  of  its  analyzer  are 
present^.  These  schemes  are  incorporated  into  a  compact  white  light  optical 
projection  system  that  is  able  to  display,  on  a  large  screen,  broadband  pseudo¬ 
color  images  of  real-world  input  scenes.  Experimental  results  demonstrating 
the  feasibility  of  the  technique  are  reported. 

Sub/tet  terms:  optics!  signs!  processing-  industris!  sppUcstions:  resi-time  imsge 
enheneemenL  pseudocolor  encoding  liquid  crystsl  television  spstisi  light  modulstors: 
white  light  processing 

Optics!  Engineering  27ISI,  3S3-3S8  tMsy  1988). 
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I.  INTRODUCTION 

Optical  pseudocolor  density  encoding  is  a  processing  tech¬ 
nique  that  maps  multiple  gray  levels  contained  in  a  black-and- 
white  image  into  a  broad  band  of  colors.  Since  human 
observers  perceive  image  variations  in  colors  better  than  in 
gray  levels  (several  thousand  versus  fewer  than  20).'  pseudo¬ 
color  encoding  techniques  are  useful  for  subtle  gray-level 
discrimination.  This  technique  can  be  used  for  .NASA  space 
exploration  mapping  analysis,  earth  resources  surveys,  mil¬ 
itary  intelligence  studies,  medical  diagnosis,  and  industrial 
inspection  applications. 

Pseudocolor  encoding  of  a  black-and-white  image  can  be 
achieved  by  halftone  screen  encoding.  A  halftone  encoded 
image  transparency  is  illuminated  by  two  superimposed  laser 
'  beams  of  different  wavelengths-  or  by  a  collimated  white  light 
Team.)  By  selective  spatial  Hltering  of  the  different  color 
'  romponents  contained  in  the  various  diffraction  orders  in  the 
.  ^  ourier  plane,  a  pseudocolor  density  encoded  image  can  be 
.  trained  in  the  output  plane.  Pseudocolor  encoding  can  also 
achieved  with  grating  encodings.*'*  In  this  method,  a  posi- 
■  (original)  image,  a  negative  image,  and  a  product  of  the 
>  are  sequentially  contact  printed  through  a  grating  onto 
ick-and-white  photographic  Him.  The  orientation  of  the 
jting  varies  with  each  exposure.  For  retrieval  of  the  pseudo- 
.olor  image,  the  encoded  image  transparency  is  illuminated 
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with  a  white  light  plane  wave.  After  color  spatial  filtering  at 
the  Fourier  plane,  each  of  the  three  encoded  image  compo¬ 
nents  passes  through  a  primary  color  filter.  Although  a  broad 
band  of  pseudocolor  can  be  obtained  satisfactorily  in  the 
output  plane  by  these  encoding  techniques,  the  fact  that  they 
are  not  real-time  techniques  has  severely  limited  their 
applications. 

Recently,  several  real-time  pseudocoloring  density  encod¬ 
ing  techniques  have  been  reported.  One  technique  utilizes  a 
contrast-reversal  spatial  filter  to  obtain  a  negative  image.  This 
negative  image  is  carried  by  a  laser  beam  of  one  wavelength 
and  superimposed  with  a  positive  image  of  a  different  wave¬ 
length.  The  mixture  of  these  two  images  generates  a  color- 
coded  image  in  real  time.'  Pseudocolor  encoding  can  also  be 
achieved  by  a  method  based  on  the  scattering  properties  of  the 
photographic  film.'  A  positive,  a  negative,  and  a  bidirection¬ 
ally  modulated  image  can  be  obtained  simultaneously  by 
illuminating  an  original  image  transparency  with  oblique 
transmission  and  diffusive  reflection.  Coding  each  of  the  three 
images  with  a  primary  color  and  superposing  them  produces  a 
pseudocolor  image.  Pseudocoloring  has  also  been  obuined 
direaly  by  using  the  birefringent  effect  of  a  liquid  crystal  light 
valve  spatial  light  modulator!  LCLV  SLM).*  Since  the  LCLV  is 
biased  at  a  specific  frequency  and  voltage  and  is  read  out  with  a 
white  light  beam,  the  output  image  is  automatically  color 
coded.  A  similar  effect  has  been  reported  with  an  LCTV  SLM.’ 

In  this  paper,  we  report  a  real-time  optical  broadband 
pseudocolor  encoding  technique  that  has  great  potential  for 
industrial  applications.  The  technique  utilizes  a  pseudocolor 
encoder  consisting  of  a  compact  white  light  projection  system 
and  an  LCTV  SLM.  This  pseudocolor  encoder  is  able  to 
display  broadband  pseudocolor  images  out  of  real-world 
input  scenes  through  a  TV  camera.  The  output  can  be  easily 
displayed  on  a  large  screen  for  direct  viewing.  In  Sec.  2.  we 
analyze  three  types  of  gray-scale  modulation  schemes  using 
the  LCTV  SLM.  These  three  schemes  form  the  basis  of  the 
pseudocolor  encoding.  Then  we  discuss  the  optical  system 
design  of  the  pseudocolor  encoder.  Finally,  experimental 
results  of  a  color-coded  gray-scale  test  pattern  and  a  contin¬ 
uous-tone  image  are  used  for  demonstration. 
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2.  GRAY-SCALE  MODULATIONS  USING  AN 
LCTV  SLM 

Since  its  introduction  three  years  ago.'®  the  LCTV  has  been 
adopted  as  an  inexpensive  electronically  addressed  SLM, 

We  show  that  the  polarization  properties  of  the  LCTV  cells 
can  be  innovatively  utilized  for  pseudocolor  encoding.  The 
basic  principle  of  the  screen  cells  is  first  presented,  and  a 
description  of  the  modulation  schemes  follows.  The  screen  of 
an  LCTV  consists  of  a  large  array  of  liquid  crystal  cells.  One  of 
the  cells  of  the  LCTV  is  shown  in  Fig.  1(a).  Twisted  nematic 
liquid  crystals  are  sealed  between  two  transparent  electrodes 
and  glass  plates.  The  cell  is  sandwiched  between  a  pair  of 
polarizers  having  their  axes  of  polarization  states  oriented  in 
parallel.  As  shown  in  Fig.  1(b).  when  no  electric  field  is 
applied  across  the  electrodes,  the  twisted  nematic  liquid  crys¬ 
tals  rotate  the  axis  of  polarization  state  of  the  incoming  light 
beams  by  90® .  The  output  analyzer,  w  hose  polarization  state 
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is  orthogonal,  will  block  the  light  beams,  and  the  “off"  state 
results.  When  a  sufficiently  intense  electric  field  is  applied  tc 
the  electrodes,  the  orientation  of  the  liquid  crystals  is  tw  istec 
back  and  thus  no  change  is  made  to  the  polarization  state  c 
the  incoming  beam.  The  light  beam  is  able  to  pass  through  t 
analyzer  in  full  amount,  and  the  "on"  state  results.  The  gra 
scale  distribution  of  its  output  image  can  be  varied  as 
function  of  the  orientations  of  its  analyzer  polarizer  .A; 
LCTV  is  therefore  a  gray-scale  device.  Since  input  scenes  art 
fed  into  the  LCTV  through  a  TV  camera  or  a  computer,  the 
array  of  cells  is  addressed  in  a  raster  scanning  mode. 

We  describe  here  three  different  gray-scalc  modulation 
schemes.  First,  as  shown  in  Fig.  2(a).  the  polarization  axis  of  the 
linearly  polarized  input  light  is  rotated  by  an  angle  0  from  its  off 
state  as  it  passes  through  the  liquid  crystal  layer.  The  rotation 
angle  £1  increases  as  a  fuction  of  the  increase  in  the  applied 
electric  field  intensity,  which  is  proportional  to  the  input  image 
intensity.  When  the  output  polarizer  is  placed  perpendicular  to 
the  off  polarization  sute.  using  Malus's  law.  the  light  amplitude 
transmittance  tp  of  the  output  image  is 

tp  =  KsinH  .  0  <  fl  <  .  { I  ( 

where  K  is  a  proportionality  constant  and  is  the  maxi¬ 
mum  value  of  the  angle  Cl.  Equation!  l)shows  that,  in  general, 
the  input  is  nonlinearlv  proportional  to  the  output:  however. 
•fAn.,  is  small,  the  output  light  amplitude  transmittance  is 
linearly  proportional  to  the  input  light  amplitude  transmit¬ 
tance.  For  convenience,  we  have  plotted  the  case  of  small 
in  Fig.  2(a).  The  output  image  is  linearly  proportional  to 
the  stepped  input  gray-level  pattern  I,„. 

Second,  a  contrast-reversed  image  of  an  input  scene  can  be 
obtained  as  shown  in  Fig.  2(b).  In  this  case,  the  orientation  of 
the  analyzer  is  perpitndicular  to  the  maximum  rotatable  angle 
of  the  liquid  crystal  (i.e..  at  H  =  Aw,)  The  light  amplitude 
transmitunce  of  the  output  image  is 

t„  =  KsinlfU,  -  0)  .  0  <  n  <  f\„,  .  (2i 

Equation  (2)  shows  that  the  output  light  amplitude  distribu¬ 
tion  is  inversely  proportional  to  the  input  light  amplitude 
distribution.  As  shown  in  Fig.  2(b).  the  output  image  I,-  is  a 
contrast-reversed  version  of  the  input  image  l,„. 
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Fig.  3.  Diagram  of  tha  raal-tima  broadband  paaudocotor  aneoding  ayatam. 


Third,  a  bidirectional  modulation  technique"  is  utilized 
for  gray-scale  modulation.  As  shown  in  Fig.  2(c),  when  the 
orientation  of  the  analyzer  is  perpendicular  to  the  bisector  of 
the  two  extreme  polarization  states  at  H =0and  fl  =  the 
intensity  transmittance  of  the  output  image  becomes 

1^,  =  K'i.n(n  -  .  0  <  n  <  .  (3) 

where  K'  is  a  proportionality  constant.  Equation  ( 3)  indicates 
that  by  using  the  bidirectional  modulation  scheme,  we  trans¬ 
form  the  middle  point  of  the  input  gray  scale  to  the  minimum 
gray  level  in  the  output.  The  highest  and  lowest  levels  of  the 
input  are  transformed  to  the  same  highest  level  in  the  output. 

This  IS  illustrated  in  Fig.  2(c). 

It  is  worth  pointing  out  that  in  Fig.  2.  the  linear  relation¬ 
ship  between  the  input  and  output  stepped  gray-level  pattern 
is  true  only  when  the  input  gray  scales  fall  in  the  linear  region 
of  the  trarsfer  characteristic  curve  of  the  LCTV  SLM.  Non¬ 
linearity  occurs  at  the  toe  and  shoulder  areas  of  the  measured 
transfer  characteristic  curves,  shown  in  Fig.  6. 

3.  OPTICAL  PSEUDOCOLOR  DENSITY  ENCODER 

Based  on  the  three  schemes  of  modulating  the  gray-scale 
distribution  of  an  input  scene  through  an  LCTV  SLM  as 
described  above,  a  pseudocolor  density  encoding  method  is 
proposed.  By  separately  encoding  each  of  the  positive,  nega¬ 
tive.  and  bidirectionally  modulated  images  with  one  of  the 
primary  colors  and  then  superposing  them,  we  can  obtain  a 
broadband  pseudocolored  image.  Figure  3  is  a  schematic 
diagram  of  this  pseudocolor  encoder.  A  real-world  scene  is 
picked  up  by  a  TV  camera  and  fed  into  the  LCTV.  A  colli¬ 
mated  while  light  is  used  to  illuminate  the  LCTV  screen 
through  a  polarizer.  (As  shown  in  Fig.  3.  both  the  polarizer 
and  analyzer  enclosing  the  LCTV  screen  are  replaced  by 
separately  rotatable  polarizers. )  A  phase  diffraction  grating  is 
placed  at  a  short  distance  behind  the  LCTV  screen.  A 
projection  lens.  L.  is  used  to  image  the  input  image  to  the 
output  plane  with  a  magnification.  At  the  back  focal  plane  of 
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lens  L.  a  set  of  three  analyzers  is  inserted  immediately  behind 
the  dispersed  image  spectrum.  Analyzer  I  is  placed  behind  the 
region  of  the  green  color  area,  analyzer  2  behind  the  blue,  and 
analyzer  3  behind  the  red.  The  remainder  of  the  image  spec¬ 
trum  is  blocked  with  an  opaque  mask.  To  perform  pseudoco¬ 
lor  encoding,  the  orientations  of  analyzers  1 .  2.  and  3  with 
respect  to  the  polarization  axis  of  the  impinging  spectrum  are 
arranged  as  depicted  in  Figs.  2(a)  through  2(c).  If  the  input 
scene  amplitude  distribution  is  t(x.y).  its  corresponding 
wavelength-dispersed  Fourier  spectrum  E(a./3)  at  the  back 
focal  plane  behind  the  analyzers  is  < 
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where  T^^.  T„^.  and  T^„  represent  the  positive  image  Fourier 
spectrum  in  green  color,  the  negative  in  blue  color,  and  the 
bidirectionally  modulated  in  red  color:  f  is  the  focal  length  of 
the  projection  lens  L:  a  is  a  constant  proportional  to  the 
grating  spatial  frequency:  C  is  a  complex  constant;  and  the 
asterisk  denotes  the  convolution  operation. 

At  the  output  plane,  the  light  intensity  distribution  may  be 
written  as 

l.(x.,l  =  jlC,[^  .„(i  ■  i)]  +  K.[i  ...(i  ■  ^)] 

where  t  is  the  positive  image  in  green.  t„j  is  the  negative  in 
blue,  and  ti^^  bidirectionally  modulated  in  red.  K,,  K,,. 
and  K,  arc  proportionality  constants  and  M  =  d„  d,  is  the 
maanirication  of  the  nroiection  svstem.  Eouation  (5)  shows 
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Pig.  4.  Expfimtittl  dainonatratioii  «f  p—udpcoleriwg  (•••  fig.  B).  Owy  »pilp  tMt  pMtam  for  (a)  Original  input  gray-acaia  taat  pattam: 
(bl  paaitiwa  imago  of  tha  input  pattam  obtabiod  from  tho  groan  apoetral  band;  (ci  nagativa  imago  of  tho  input  pattam  obtainod  from  tho  Mua 
•paetral  band:  (d)  bidiroctiortally  modulotad  bttaga  of  tho  input  pattam  oMabtod  from  tho  rod  apoetrai  band. 


that  the  output  image  is  a  superposition  of  the  red.  green,  and 
blue  of  the  input  image.  Each  has  been  gray-scale  modulated 
and  thus  pseudocoloring  is  achieved. 

4.  EXPERIMENTAL  RESULTS 

We  performed  some  experiments  to  demonstrate  the  feasibil¬ 
ity  of  the  real-time  pseudocolor  encoding  idea.  In  our  experi¬ 
ments.  we  used  an  EPSON  LCTV  model  ET-10  SLM.  This 
LCTV  screen  conuins  220  X  240  cells.  Each  contains  a  thin- 
nim  transistor  (TFT)  that  is  able  to  lock  up  the  rotation  angle 
of  the  liquid  crystal  after  each  scanning.  Because  of  the  use  of 
the  TFT.  the  resultant  contrast  ratio  is  much  higher  than  that 
of  the  Radio  Shack  model.*  However,  since  the  EPSON 
LCTV  is  a  color  TV.  we  addressed  it  with  a  black-and-white 
CCD  TV  camera  to  avoid  mixing  up  the  pseudocolor  with  real 
color.  The  white  light  source  was  a  75  W  xenon  arc  lamp.  A 
dichromated  gelatin  phase  grating  was  placed  about  I  cm 
behind  the  LCTV  screen  to  avoid  imaging  the  defeas  located 


on  the  surface  of  the  grating  onto  the  output  plane.  The 
imaging  lens  was  a  f/ 1 .8  achromat.  Three  steps  were  taken  in 
the  preparation  of  the  polarizer  filters  for  pseudocolor  encod¬ 
ing.  First,  a  polarizer  was  placed  at  the  Fourier  plane  over  the 
green  spectral  band,  with  its  polarization  state  oriented  paral¬ 
lel  to  that  of  the  input  polarizer.  A  positive  green  output  image 
similar  to  that  of  the  input  object  was  obtained  at  the  output 
plane.  A  second  polarizer  was  then  placed  over  the  area  of  the 
blue  spectral  band,  with  its  polarization  state  rotated  about 
SO*  away  from  the  first  polarizer.  This  polarizer  generated  a 
contrast-reversed  blue  image  at  the  output  plane.  Finally,  a 
third  polarizer  was  placed  over  the  red  spectral  band,  with  its 
polarization  sute  oriented  between  those  of  the  first  and  the 
second  polarizers  (i.e..  about  25®  away  from  the  first  polar¬ 
izer).  The  third  polarizer  produced  a  red  bidirectionally  mod¬ 
ulated  image  of  the  input  scene.  The  simultaneous  use  of  the 
three  encoding  polarizers  results  in  a  broadband  pseudo¬ 
colored  image  of  a  gray-scale  input  image.  With  an  appro- 
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OPTICAL  PSEUDOCOLOR  IMAGE  ENHANCEMENT  WITH  REAL-TIME  LARGE  SCREEN  DISPLAY 


Fig.  9.  PMwdocotoraneodadwiMgaa/tfMinputpatMfnoMAifMdbv 
$up«rpowtiOfiing  th«  iwagt  •tiown  in  Fig«.  thraogb  4(d). 


Fig.  7.  Input  imagp  of  a  goH  baM  for  axparimontal  damonttration  of 
ttia  paaudocoiortng  of  a  eontinuoua-tona  imago  Itaa  Fig.  8). 


Fig.  8.  Output  gray-laval  distribution  vortuatba  input  gray-lovotdia- 
tribution  as  a  function  of  tha  oriantationa  of  tfw  analviar.  Tbo 
raauHa  waro  maaaurad  from  an  EPSON  modal  ET-10 ICTV  SUM. 


Fig.  S.  Paaudocolor  ancodad  imaga  of  tbo  continuoua-tona  input 
imago  atiown  in  Fig.  7. 


priate  magnirication.  the  output  can  be  displayed  on  a  large 
diffuse  screen. 

In  our  first  experiment,  we  studied  the  effectiveness  of  the 
three  gray-scale  modulation  schemes  by  using  a  photographic 
gray-scale  test  pattern  as  the  input  object.  Figure  4(a)  shows 
an  original  input  gray-scale  test  pattern:  Fig.  4(b)  shows  a 
positive  image  of  the  test  pattern  recorded  from  the  green 
spectral  band  of  the  optical  encoder;  Fig.  4(c)  shows  a  nega¬ 
tive  image  of  the  input  object  obuined  from  the  blue  spectral 
band:  and  Fig.  4(d)  shows  a  bidirectionally  modulated  image 
of  the  input  object  obtained  from  the  red  spectral  band. 
Comparing  Fig.  4(d)  with  Fig.  4(b)  we  see  that  the  inter¬ 
mediate  and  the  darkest  gray  scales  in  Fig.  4(b)  were  trans¬ 
formed  respectively  into  the  darkest  and  brightest  gray  scales 
in  Fig.  4(d).  The  brightest  gray  scale  in  Fig.  4(  b)  remained  the 
same  in  Fig.  4(d).  A  color  photograph  of  the  resultant  pseudo¬ 


color  encoded  image  made  by  superimposing  the  three  pri¬ 
mary  color  images  is  shown  in  Fig.  5.  The  brightest  pattern 
was  mapped  into  green  color,  the  darkest  pattern  was  mapped 
into  purple  color,  and  intermediate  gray  scales  were  mapped 
into  a  broad  band  of  color  ranging  from  orange  through 
yellow  to  yellow-green.  A  plot  of  the  measured  output  image 
gray-scale  distribution  versus  the  input  pattern  gray-scale 
distribution  is  shown  in  Fig.  6.  From  Fig.  6.  we  found  that  the 
output  image  contrast  ratios  of  the  positive  and  of  the  nega¬ 
tive  image  were  both  about  20: 1 .  The  contrast  ratio  of  the 
bidirectionally  modulated  image  was  only  about  8:1. 

In  a  second  experiment,  we  selected  a  golf  ball  as  the  input 
objeo.  The  golf  ball  was  illuminated  by  a  photo  lamp  from  its 
right  rear  side.  The  slowly  varying  curvature  of  the  ball  gener¬ 
ated  an  image  containing  a  wide  range  of  gray  scale,  as  can  be 
seen  in  Fig.  7.  Figure  8  shows  the  pseudocolor  encoded  picture 
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of  Fig.  7.  Five  vivid  colors  that  outlined  the  contours  of  five 
slices  of  gray  levels  over  the  surface  of  the  golf  ball  can  be  seen. 
This  result  funher  demonstrates  the  capability  of  the  pseudo¬ 
color  encoder  in  encoding  images  of  real-world  input  in  real 
time. 

5.  CONCLUSIONS 

We  have  described  three  schemes  for  the  modulation  of  gray- 
level  distribution  of  an  input  scene  fed  into  an  LCTV  SLM 
and  have  utilized  the  principle  to  build  a  pseudocolor  encoder. 
We  have  also  described  a  compact  white  light  projection 
system  that  is  able  to  encode  and  project  the  pseudocolor 
image  onto  a  large  screen.  The  principle  of  pseudocolor 
encoding  is  also  achievable  by  using  other  SLMs  such  as  the 
LCLV.  the  SIGHT  magneto-optic  device  (MOD),  and  micro- 
channel  plate  SLM  instead  of  the  LCTV  SLM.  However, 
from  a  practical  point  of  view  ,  the  LCT\’  SLM  is  quite  suit¬ 
able  for  this  application  because  of  its  low  cost  as  well  as  its 
being  electronically  addressable.  W'ith  a  large  screen  display, 
the  pseudocolor  encoding  system  can  be  used  in  many  indus¬ 
trial  applications  such  as  multicolor  display,  thermal  image 
enhancement,  and  medical  imaging  enhancement. 
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Abstract 


In  this  paper,  an  inner-product  array  processor  for  the  associative  retrieval  problem 
is  presented.  First,  the  algorithm  and  architecture  of  the  array  processor  design  are 
discussed.  Then  an  optical  Implementation  scheme  is  proposed.  The  matrix  model  of  the 
associative  memory  is  adopted.  In  this  model,  if  one  of  the  M  vectors  is  to  be  reliably 
recalled,  the  dimension  of  the  vectors,  N,  must  be  much  larger  than  M.  By  taking  advan¬ 
tage  of  this  fact,  our  result  offers  a  factor  of  ^N/M  saving  on  the  matrix  elements. 

More  significantly,  real-time  inputting  and  updating  of  the  matrix  elements  can  be 
potentially  implemented  with  existing  space-variant  holographic  elements  and  recently 
discovered  liquid  crystal  television  spatial  light  modulators. 

I.  Introduction 

Optical  array  processors  have  a  great  potential  because  of  their  parallelism,  high 
computational  races,  small  size  and  weight,  and  their  low  power  dissipation  and  cost. 

These  processors  naturally  offer  the  same  strength  of  VLSI  in  terms  of  massive  parallelism 
and  yet  circumvent  the  limitation  on  communication  inherent  in  VLSI  processors. 

In  this  paper,  we  discuss  an  optical  processor  design  for  an  associative  retrieval 
processing  system.  We  shall  first  present  a  brief  history  of  the  evolution  of  distributed 
associative  memory  networks,  and  the  essential  algorithmic  and  architectural  design 
considerations.  These  then  lead  to  a  unique  optical  implementation  of  the  inner-product 
array  processor  for  the  associative-retrieval- problems .  There  are  two  memory  types  in  the 
current  computer  design;  one  is  location  addressable  and  the  other  is  content 
addressable.  It  has  been  recognized  that  the  content-addressable  type  is  more  closely 
related  to  how  the  human  brain  functions.  In  fact,  a  popular  approach  to  its 
implementation  is  based  on  one  which  resembles  that  of  a  neuro-network.  Neural  signals 
are  trains  of  pulses  with  variable  frequencies.  The  task  of  memory  is  to  reproduce  the 
neural  signal  at  the  places  where  they  earlier  occurred.  This  leads  to  the  notion  of 
associative  memory  network  and  associative  retrieval,  whose  main  features  include 
recognition  and  error  correction  based  on  partial  or  cluttered  input. 

It.  A  Brief  Historical  Note 


Since  the  1970's,  the  correlation  matrix  model  of  the  distributed  associated  memory 
network  has  been  gaining  popularity.  Notably,  Kohonen,  Nakano,  and  Anderson  have  done 
independent  work  in  this  area  in  the  early  1970' s.  A  brief  history  is  presented  below, 
and  key  references  are  provided  for  researchers  who  have  interests  in  more  details  of  the 
evolution  of  associative  memory  networks. 

Note  that  the  conception  of  associative  memory  can  trace  all  the  way  back  to 
Aristotle's  work  [370  B.C.l  on  memory  and  reminiscence.  The  cybernetic  research  work  in 
1950's  on  learning  digital  neworks,  perceptron,  and  conditioned  connection  crossbars  (1-31 
has  paved  ways  for  the  modern  era  of  studies  on  the  subject.  In  the  1970's,  the  matrix 
model  (as  distinguished  from  the  connection  model)  of  memory  networks  seems  to  have  gained 
the  attentions  of  many  researchers.  These  work  are  represented  by  Norishlta  [4] ,  Kohoner 
IS],  Nakano  (6),  Anderson  [71.  More  recently,  Hopfield  [81  further  extended  the  previous 
works  to  structure  a  eonputatlonal  model  by  a  notion  of  energy  functions  with  an 
outer-product  computing  model  on  a  iterative  basis.  To  memorize  a  number  of,  say  H, 
N-tuple  vectors,  Hopfield  has  found  through  computer  simulations  that  a  vector  among  M  can 
be  successfully  recalled  if  M  is  less  than  0.15N. 
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III.  An  innec-oroduct  eoniDutinq  model  for  associative  retrieval 

One  of  the  most  .elementary  operations  Implemented  by  associative  memory  Is  the 
associative  recall  system.  While  Psaltls  and  Farah  [9,  101  have  presented  the  optical 
implementation  of  associative  recall  model  based  on  the  outer-product  of  the  matrix,  we 
propose  a  model  that  is  based  on  the  inner  product  of  the  matrix_with  an  array  of  M 
matrices.  The  dimensions  of  each  matrix  in  the  array  are  /tf  x  /'N  and  the  array  is 

X  .  We  assume  that  /fT  and  /IT  are  integers.  The  dimensions  of  the  array  are  /M  N  x 
/R  «  MN  which  is  less  than  the  dimensions  N  x  N  of  the  outer-product  matrix  model 
since  N  >  M. 

Referring  to  Figure  1,  the  iterative  computation  is  represented  by 

V*  < - Tj  [AVI  (II 


Figure  1.  An  iterative  computing  model  for  associative  retrieval. 

'vhere  A  is  a  N  x  N  associative-recalling  matrix,  which  is  assumed  to  be  ‘pre-taughf 
(i.e.,  non-adaptive)  ,  and  (  •  1  is  a  thresholding  operation  with  threshold  »  9.  In 
'.he  non-adaptive  case,  the  rank  of  A  is  always  equal  to  the  total  number  of  information 
patterns,  M.  If  the  columns  of  A,  representing  memorized  patterns,  are  nearly  orthogonal, 
then  a  pattern  may  be  retrieved  by  its  partial  information,  in  order  to  guarantee  a 
rooust  and  reliable  information  retrieval,  M  should  be  much  smaller  than  the  total  number 
of  features,  N,  for  example  d  «  U.IS  x  N.  This  Implies  that  A  can  be  expressed  as 


n 


V, 


'’or  a  set  of  vectors  ((/<,  V^>;  i  •  1,...,M.  (Under  the  special  circumstance  of 
"auto-associative*  recall,  then  Ui  ■  V^.) 

The  inner  product  array  processor  exploits  the  fact  chat  M<<N,  and  achieves  a 
considerable  amount  of  hardware  savings.  The  computation  in  Eg.  (1)  now  becomes 


This  can  be  subsequently  decomposed  into  four  steps: 


''cep  !1) 

T 

Xi  -  U.V 

,  for  i  ”  1  . . . ,  Mj 

Step  (2) 

Ti  -  Vi 

Xi  for  1  -  1,...  H; 

•Step  (3) 

^  "  ] 

^  ’^i' 

l' 

Step  (4) 

V"  .  Tg 

121  t 

The  four 

separate 

steps  of  this  new  computing  model  are  depicted  in  Figure  2 

(2) 


Referring  to  the  schematic  diagram  in  Figure  2,  both  the  I.P.O.  and  v.s.o.  may  be 
implemented  in  parallel  via  an  optical  array  processor.  In  this  case,  each  N-dimensional 
I.P.O.  (or  v.s.o.)  may  be  implemented  by  one  x  /IT  "optical-plane-product,"  as  shown 
in  Figure  3.  This  means  that  a  much  more  compact-size  optical  implementation  process  is 
now  possible. 


IV.  A  optical  implementation  of  a  programmable  associative  recall  system 
An  optical  system  for  implementing  the  inner-product  associative-retrieval  model  as 
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Figure  2.  The  inner  product  computing  model  where  l.P.O.  represents  an  inner  proouct 
operator  and  V.S.O.  represents  a  vector  scaling  operation. 


(8)  (1-fh)  l.P.O.,  I  •  1.  2 . M.  0))  (Hh)  V.S.O.,  I  -  1,  2 . M. 


Figure  3.  A  scnematlc  diagram  of  the  optical  implementation  of  l.P.O.  and  V.s.o. 


discussed  above  Is  shown  in  Figure  4.  In  the  Figure,  a  liquid  crystal  television  (LCTV) 

Is  used  as  an  electronically  addressed  spatial  light  modulator  (SLM).  In  fact,  other 
electronically  addressable  SLM's  such  as  the  Hughes  CCO-addressed  LCLV  may  also  be  able  to 
serve  the  same  function  as  the  LCTV.  Two  multiple-focus  holographic  lenses^*  (hololens), 
HHLl  and  HHL2  are  used  as  space-varient  optical  elements  for  performing  the  necessary 
inner->product  and  summation  functions.  The  function  or  capability  of  the  MHL's  is  shown 
in  Figure  5.  The  holographically-made  optical  element  is  capable  of  replicating  an  input 
2-0  image  by  first  focusing  it  to  an  array  of  focal  points  at  its  focal  plane  and  then 
forming  an  array  of  images  at  its  image  plane.  All  the  replicated  images  are  derived  from 
a  single  image  through  the  common  aperture  of  the  NHL;  a  capability  that  cannot  be 
achieved  by  any  currently  available  refractive  elements  such  as  a  glass  lens. 

To  set  up  the  optical  array  processing  system,  we  first  display  the  M  known  vectors  on 
the  LCTV  each  in  a  /R  by  /IT  matrix  format.  The  nature  of  the  LCTV’s  transmissive 
screen  is  to  modulate  the  iMut  laser  light  by  what  is  being  written  according  to  the 
matrix-format  vector.  The  /R  x  /JT  matrices  being  written  or  displayed  on  the  LCTV 
screen  exhibit  its  storage  capacity  and  the  transmission  modulation  property  of  the  screen 
enable  these  matrices  to  be  multiplied  by  other  matrices.  Hence  once  the  writing  process 
is  completed,  the  storage  step  is  dons. 

To  activate  the  addressing-recalling  mode  of  operation  of  the  system,  an  input  vector 
can  be  invoked.  The  N-tuple  vector  should  be  of  the  same  matrix  format  as  that  of  any  on» 
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Figure  4.  A  schematic  diagram  of  an  optical  implementation  of  the  inner-product  array 
processor . 


Figure  S.  The  function  of  a  multiple- focus  holographic  lens. 

can  Oe  invoked.  The  N-tuple  vector  should  be  of  the  same  matrix  format  as  that  of  any  one 
•'f  the  M  vectors  so  that  it  can  be  written  onto  LCTVO.  The  screen  of  LCTVO  can  then  be 
usea  to  modulate  the  collimated  laser  beam  through  the  cube  beam  splitter  BO.  Tho 
information  being  written  on  LCTVO  can  then  be  sent  to  address  the  ('  vectors.  After  the 
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light  carrying  the  vector  information  transmitted  through  B1  and  HHLl ,  it  is  replicated  t; 
a  /W  by  ■TR  (here  we  assume  that  /m  is  an  integer)  array  of  matrices  of  /n  x  /K 
aimensions  of  elements  coinciding  matrix  by  matrix  with  what  has  been  previously  storec  m 
LCTVl .  The  inner-product-type  operation  is  tnus  partially  achieved  at  t'^is  step.  To 
complete  the  entire  inner  product  process,  the  multiplied  results  are  followed  by  a 
diffuser  which  averages  the  light  intensity  and  yield  the  M  inner-product  scalars.  Thf 
scalars  are  then  transmitted  through  to  another  array  of  M  known  vectors  displayed  (cr 
written)  on  LCTV2 .  (Computationally,  this  process  implies  that  the  M  vectors  are 
multiplied  with  tne  scalar.)  The  matrix  array  on  LCTVl  and  LCTV2  should  oe  identical  in 
case  of  auto-associative  retrieval-  Finally,  the  weighted  vectors  (or  matrices)  are 
.summed  up  by  MHL2  which  plays  a  reversed  role  as  MHLl.  A  TV  camera  or’ CCD  detector  array 
can  be  used  to  detect  the  output.  The  output  should  be  thresholded  by  an  electronic 
device.  (The  thresholded  array  may  also  he  performed  by  an  optical  device  if  a  hign-gamma 
spatial  lignt  modulator  is  available.)  Tf  the  electronic  device  is  adopted  (as  snoun  in 
Figure  4),  the  thresholded  result  can  be  written  on  LCTVl  and  illuminated  by  a  collimate 
laser  light  from  BO.  This  thresholded  matrix  is  then  used  as  a  feed-back  input  through 
and  MHLl  ready  for  a  new  iteration  process. 

The  above-mentioned  procedure  will  repeat  until  a  steady-state  is  reached  ana  exhibited 
in  the  display  sent  also  through  B1 .  Once  the  steady-state  is  reacnec,  the  retrieval 
process  is  thus  completed. 

A  partial  optical  set-up  of  the  inner-product  associative-retrieval  model  is  shown  in 
Figure  6.  In  the  forefront,  a  LCTV  imbedded  in  a  liquid  gate  is  shown.  The  electric 
connection  to  the  LCTV  is  also  visible.  At  this  stage,  the  set-up  is  only  for  the  purpose 
of  testing  the  quality  of  the  LCTV  in  its  applications  as  a  spatial  light  modulator.  Tho 
results  of  the  testing  are  important  to  the  implementation  of  the  associat ive-retrieval 
mooel . 


Figure  6.  A  photograph  of  a  part  of  the  laboratory  set-up  of  the  optical  inner-product 
array  processor. 
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Conclusions 


The  principle  and  iriplementation  of  a  programmaole  associative  recall  system  Cased  on 
tne  inner-product  model  have  been  described.  Advantages  of  the  system  include: 

1.  The  dimensions  of  the  matrix  in  the  computation  have  been  reduced.  For  example, 
in  tne  Kohonen-Nakano-Hopf ield  model,  the  dimension  of  tne  required  memory  matrix  is  N  x 

Whereas  in  the  present  case  we  only  need  an  array  of  M  matrices  of  dimension  /TT  x 
Numerically,  if  N  •  lUO  and  M  ■  4,  then  a  2  x  2  array  of  10  x  10  matrices  is 
required  in  the  inner-product  model,  instead  of  a  lUO  x  100  memory  matrix.  If  N  ■  900, 

'1  «  100,  then  a  10  X  10  array  of  30  x  30  matrices  is  sufficient  to  perform  the  retrieval 
function.  Therefore,  one  order  of  magnitude  of  saving  on  the  memory  matrix  elements  can 
i>e  achieved  and  make  the  optical  implementation  more  feasible. 

2.  The  optical  implementation  exploits  the  newly  developed  inexpensive  LCLV  as 
spatial  light  modulators  and  multifocus  lens  as  the  replicating,  holographic 
interconnecting,  and  matrix-matrix  multiplication  processors. 

.  Real-time  modification  of  the  memory  can  be  achieved  by  changing  the  matrix 
elements  through  electronically  reprogramming  the  LCTVs. 

We  are  hopeful  that  the  proposed  inner-product  model,  once  realized,  will  be  very 
useful  for  many  associative  memory  applications. 
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Abstract.  A  real-time  optical  associative  retrieval  technique  is  presented  The 
associative  retrieval  model  enables  a  large  amount  of  data  to  be  stored  and 
recalled  by  partial  information  optically  in  real  time  The  real-time  capability  is 
achieved  by  using  an  efectronicslly  addressed  spatial  light  modulator  based  on 
the  pocket-size  liquid  crystal  display  television.  The  potential  application  of  the 
technique  to  the  perceptive  vision  requirements  in  telerobotics  for  achieving 
NASA's  goals  of  automation  in  space  is  described. 

Subieei  termt:  Speee  Sletion  optics,  optieol  processing  outomotion  and  robotics,  liquid 
ervstoHeteifision  spuiot  light  mo&ulotor  (ICTV  SLMA  multiple- locus  holographic  lens 
(hohlensk  ossocMne  retrievot  real-time  robotic  eisiort  corraletor 

Optical  engineering  25(71  SS3-8S6fJuly  1986). 
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I.  INTROOL’CTION 

NASA-JPL  hast  major  program  in  automation  and  robotics 
(AAR)  for  planetary  exploration.  To  date,  the  developments 
of  sensing  and  perception  of  the  AAR  program  have  been 
based  mainly  on  digital  computer  meth^s,  which  have  the 
advantage  of  flexibility  and  reprogrammability.  However, 
digital  techniques  are  restricted  by  their  limited  space>band- 
w  idth  product  (SBP),  especially  in  the  perception  of  multiple 
objects  with  complex  structures  moving  with  six  degrees  of 
freedom.  The  inherent  parallelism  of  optical  processing  and 
its  large  SBP  therefore  naturally  offer  an  alternative  and/or 
complementary  approach  to  digital  optical  processing 
for  AAR. 

In  this  paper,  we  discuss  an  optical  system  utilizing  the 
pocket-size  liquid  crystal  televison  (LCTV)  as  a  spatial  light 
modulator  (SLM).  This  system  can  be  used  for  real-time 
associative  memory  and  pattern  recognition  in  space  applica- 
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tions.  First,  we  discuss  the  characteristics  of  the  LCTTV.  Then 
we  show  the  potential  usage  of  the  LCTV  in  an  inner  product 
associative  memory  model.  Finally,  we  outline  the  immediate 
and  long-range  goals  of  work  to  apply  these  techniques  in  the 
AAR  program. 

2.  EXPERIMENTAL  EVALUATION  OF  THE  LCTV  SLM 

Optical  pattern  recognition  has  been  limited  by  the  unavail¬ 
ability  of  real-time  two-dimensional  spatial  light  modulators. 
Among  the  commercially  available  SLMs  are  the  liquid  crys¬ 
tal  light  valve  (LCLV),<  the  magneto-optic  spatial  light  modu- 
lator,’  and  the  microchannel  spatial  light  modulator.^  These 
SLMsare  very  expensive.  Recently,  however,  several  versions 
of  a  small,  inexpensive,  compact  liquid  crysul  television  have 
become  commercially  available,  and  their  properties  for  opti¬ 
cal  data  processing  have  been  explored.*'’  Salient  features  of 
these  devices  for  use  in  an  associative  memory  system  will  First 
be  discussed. 

Although  various  versions  of  the  LCTV  are  commercially 
available,  most  of  our  experiments  have  been  done  with  the 
Radio  Shack  LCTV  (Realistic  Pocketvision  Cat.  No.  16-ISI 
or  I6-IS3)  with  a  S.4  cm  by  4.4  cm  Krcen.  The  screen  has  a 
two-dimensional  grid  of  raiter-acanned  liquid  crysul  cells, 
each  of  which  modulates  the  light  transmitted  through  it.  The 
resolution  is  typically  146  horizomalelements  by  1%  vertical 
elements  that  are  each  370  pm  by  370  pm  square.  The  LCTV 
comes  equipped  with  a  video  input  jack  that  allows  an  image 
to  be  written  electronically  with  a  microcomputer  or  with  a 
TV  camera. 

Each  cell  of  the  LCTV  screen  isaOO*  twisted  nematic  liquid 
crystal  between  parallel  polarizers.  When  no  electric  field  is 
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applied,  the  plane  of  polarization  for  linearly  polarized  light 
incident  on  the  cell  i*.  rotated  through 90°  hy  the  luisted  liquid 
crystal  molecules,  and  no  light  is  transmitted  through  the 
second  polarizer.  However,  under  an  applied  electric  field,  ihe 
tw  ist  and  tilt  of  the  liquid  crystal  molecules  are  altered,  affect¬ 
ing  the  rotation  angle  of  the  transmitted  light  and  therefore 
vary  ing  the  amount  of  light  transmitted  through  the  second 
polarizer. 

Voltage  is  applied  to  each  pixel  through  horizontal  and 
vertical  line  electrodes  that  intersect  attach  pixel.  The  voltage 
applied  to  each  pixel  is  determined  by  two  factors.  First,  an 
adjustable  brightness  control  applies  a  uniform  voltage  to 
every  pixel,  allow  ing  the  transmission  level  of  the  entire  screen 
to  be  uniformly  varied.  In  addition,  the  input  signal  from  the 
TV  receiver,  computer,  or  TV  camera  then  varies  the  individ¬ 
ual  voltage  applied  to  each  pixel,  thus  modulating  the  indi- 
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vidual  transmission  ol  each  pi.vcl  and  creating  the  pictcrc 

Experiments  studsing  the  polarization  ol  the  light  trjn-- 
mitted  by  the  liquid  crystal  cells  were  periormed  after  th-. 
second  polarizer  was  removed  from  the  LC I  V.  1  he  tran'm.! 
ted  polarization  state  was  analyzed  with  a  second  rotatahic 
polarizerasa  function  of  bias  voltage  across  the  LCT\  at  the 
Hc-Nc  laser  wavelength  of  6.^2. H  nm.  The  brightness  adjust¬ 
ment  on  the  LCTV  provided  control  of  this  voltage  and  was 
monitored  using  the  LCTV  control  electronics.  The  plane  o; 
polarization  transmitted  through  the  liquid  crystal  elements 
was  essentially  linear  and  rotated  as  the  brightness  controi 
voltage  was  varied,  as  shown  in  Fig.  I .  The  two  curves  show 
results  w  hen  the  computer  monitor  was  turning  every  pixel  on 
and  when  every  pixel  was  turned  off.  The  two  curves  essen¬ 
tially  differ  by  a  rotation  angle  of  1 1°.  The  transmitted  iight 
intensity  will  then  vary  upon  ( I )  applyinga  v  oltage  from  either 
the  television  camera  or  computer;  (2)  changing  the  brightness 
control  voltage;  or  (.^)  varying  the  angle  of  the  second  polar¬ 
izer.  Note  that  this  latter  degree  of  freedom  can  be  changed 
only  if  the  second  polarizer  is  removed  from  the  LCT\'. 

Although  only  binary  operation  is  available  under  com¬ 
puter  control.  limited  gray  scale  operation  can  be  obtained  by 
addressing  the  LCTV  using  a  telev  ision  camera. 

Because  the  LCTV  is  not  optically  flat,  there  is  a  phase 
nonuniformity  across  the  surface  that  destroys  much  of  its 
capability  as  a  S  LM .  This  effect  w  as  examined  by  studying  th  - 
Fraunhofer  diffraction  pattern  produced  by  the  dev  ice.  Light 
froma  He-Ne  laser  was  collimated  and  sent  througha  36  s  cm 
focal  length  lens.  A  diode-array  detector  placed  in  the  focal 
plane  of  the  lens  was  used  to  record  the  Fraunhofer  diffraction 
pattern.  Figure  2(a)  shows  the  focused  spot  produced  by  the 
system.  Figure  2(b)  shows  the  broadening  of  the  focused  spot 
when  the  LCTV  is  introduced  into  the  system.  This  broaden¬ 
ing  is  evidence  of  phase  nonuniformitv  across  the  plane  of 
the  LCTV. 
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I  hcM-  pliiixc  varuiiioris  were  curreeied  he  placing  ihe 
I.CI\  iiiMde  a  Neupi>ri  Corporation  Model  550-(i  lii)uid 
gate  tilled  with  mineral  oil.  This  Mep  succcssfuUe  eliminated 
the  piiase  variations,  as  shown  by  Ihe  sharply  focused  spot  in 
Fig  2le) 

Alter  these  phase  nonuniformitics  were  removed  with  the 
liquid  gale,  the  dev  ice  was  successfully  used  as  the  input  stage 
for  an  optical  correlator.*  ' 

In  conclusion,  our  experiments  show  that  the  LCTV  can  be 
a  highly  versatile  SLM  when  used  in  conjunction  with  a  liqu'd 
gate,  as  described  above.  Moreover,  the  device  is  very  in¬ 
expensive  and  can  be  easily  interfaced. 

3.  OPTICAL  I.MPLE.MENTATION  OF  A  PROGRAM¬ 
MABLE  ASSOCIATIVE  RECALL  SYSTEM  t'Sl.NG 
LCTV  SL.Ms 

The  algorithm  and  architecture  of  an  inner  product  associa¬ 
tive  retrieval  technique  have  been  published  prev  iously.*  This 
system  allows  an  input  vector  to  be  compared  with  M  stored 
test  vectors. 

An  optical  system  for  implementing  the  inner  product 
associative-retrieval  model  is  shown  in  Fig.  3.  In  the  figure, 
the  LCTV  as  described  above  is  used  as  an  electronically 
addressed  SLM.  Two  multiple-focus  holographic  lenses 
(hololenses).'  MHLI  and  MHL2.  are  used  as  space-variant 
optical  elements  for  performing  the  necessary  inner  product 
and  summation  functions.  The  function  or  capability  of  the 
MHLs  is  shown  in  Fig.  4.  The  holographically  made  optical 
element  is  capable  of  replicating  an  input  2-D  image  by  first 
focusing  It  onto  an  array  of  focal  points  at  its  focal  plane  and 
then  forming  an  array  of  images  at  its  image  plane.  All  of  the 
M  replicated  images  are  derived  from  a  single  image  through 
the  common  aperture  of  the  MHL.  a  unique  capability  that 
cannot  be  achieved  with  a  refractive  element  such  as  a 
glass  lens. 

To  set  up  the  optical  array  processing  system,  we  first 
display  the  M  known  vectors  on  LCTV  I .  each  in  a  ^  by 
matrix  format.  The  M  vectors  are  stored  in  a  v/R  by  v/R 
formal.  The  transmissive  screen  of  the  LCTV  modulates  the 
input  laser  light  at  each  spatial  location  in  the  two-dimen¬ 
sional  screen.  Hence,  once  the  writing  process  is  completed, 
the  storage  step  is  done. 

To  initiate  the  addressing-recalling  mode  of  operation  of 
the  system,  an  input  vector  can  be  invoked.  The  N-tupIc 
vector  should  be  of  the  same  matrix  formal  as  that  of  any  one 
of  the  M  stored  vectors.  The  screen  of  LCTVO  can  then  be 
used  to  modulate  the  collimated  laser  beam  through  the  cube 
beamsplitter  BO.  The  information  being  written  on  LCTVO 
contains  one  of  the  M  vectors.  After  the  light  carrying  the 
vector  information  is  transmitted  through  Bl  and  MHLI.  it  is 
replicated  to  a  v/Rby  v/R(we  assume  that  M  is  an  inteferl 
array  of  matrices  of  ^  by  dimensions  of  elements  coin¬ 
ciding  matrix  by  matrix  with  what  has  been  previously  stored 
in  LCTV  I .  The  inner  product  type  of  operation  is  thus  par¬ 
tially  achieved  at  this  step. 

To  complete  the  inner  product  process,  the  multiplied 
results  are  followed  by  a  diffuser  that  averages  the  light 
intensity  and  yields  the  M  inner  product  scalars.  The  scalars 
are  then  transmitted  through  (i.e..  multiplied)  to  another 
array  of  M  known  vectors  displayed  (or  written  on)  I.CTV2. 
T  he  matrix  array  son  l.Cl  VI  and  LCTV2  should  be  identical. 
Finally,  the  weighted  vectors  (or  matrices)  are  summed  by 
Mill  2.  which  plays  a  reversed  role  Irom  Mill  I.  A  IV 


Fig  4.  Function  of  tha  multipla- focus  holographic  Ians. 


Fig.  S.  Photograph  of  a  part  of  tha  laboratory  aatup  of  tha  optical 
innar-product  array  procatsor. 


camera  or  CCD  detector  array  can  be  used  to  detect  the 
output.  The  output  should  be  thresholded  by  an  electronic 
device.  (The  thresholded  array  may  also  be  performed  by  an 
optical  device  if  a  high-gamma  spatial  light  modulator  is 
available.)  If  the  electronic  dev  ice  is  adopted  (as  shown  in  Fig 
3).  the  thresholded  result  can  be  written  on  LCTV3  and  illumi¬ 
nated  by  a  collimated  laser  light  from  BO.  This  thresholded 
matrix  is  then  used  as  a  feedback  input  through  Bl.  and 
MHLI  is  ready  for  a  new  iteration  process.  This  procedure 
will  repeat  until  a  steady  state  is  reached  and  exhibited  in  the 
display  sent  also  through  Bl .  Once  the  steady  state  is  reached, 
the  retrieval  process  is  thus  completed. 

A  partial  optical  setup  of  the  inner  product  associative 
retrieval  model  is  shown  in  Fig.  5.  In  the  forefront,  a  LCTN 
imbedded  in  a  liquid  gate  is  show  n.  The  electronic  connection 
to  the  LCTV  is  also  visible.  The  setup  is  for  the  purpose  of 
testing  the  quality  of  the  l.Cl  V  in  its  application  as  a  spatial 
light  modulator.  I  he  results  ol  the  testing  are  important  to  the 
iniplenieni.ition  ol  the  associ.iH'e  leirieval  model. 

I  he assoi'iativ e  letrieval  nioilel  heeoniesa  pattern  recogni¬ 
tion  vvstein  it  one  views  the  M  \eeiois  iis  prestored  images  of 
the  ohieels  iiiulei  iiivestig.itioii  Lse  ol  the  eleetronicallv 
.nl.lu  ^^.lhleM  M  .illowseompiilei  iipil.ile  ol  piesloied  images 
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4.  (  <)N(  I  rSI()NS-RKI,KVA\(  K  TO  TIIK  A&R 
I'KOOKAM  AT  NASA-JIM. 

1  he  N  ASA  Space  Station  antteipate>  automated  robot\  per¬ 
forming  pro(:reNsivel>  unsuperx  ised  and  unconstrained  tasks. 

I  his  requires  .^-D  sieu -independent  and  eonteM-sensitivc 
scene-understandinj!  eapahilits .  The  computer  systems  avail¬ 
able  today  are  inadequate  because  they  are  limited  to  simple 
object  recognition  in  unoccludcd  and  highly  structured  task 
environments.  Therefore,  new  e.vpert  vision  algorithms  and 
architectures  arc  needed  that  can  reason  about  task-specific 
knowledge  to  ( I )  intelligently  control  sensor  deployment  and 
feature-extraction  algorithm  parameters.  (2)  resolve  ambi¬ 
guity  in  alternative  scene  interpretations,  and  (3|  create  and 
maintain  stable  world  models  useful  for  path  planning  and 
verification. 

Optical  array  processors  offer  the  potential  for  high  com- 
putatiorul  rates  and  parallelism  in  small  lightweight  packages 
with  low  power  requirements.  The  inner-product  associative 
retrieval  and  compact  large  memory  optical  implementation 
will  be  useful  for  the  reail^at^on  of  the  perceptive  vision  for 
telerobots  for  Space  Station  applications.  As  described 
above,  the  system  has  great  versatility  since  both  the  M  stored 
vectors  and  the  test  vector  can  all  be  easily  and  remotely 
updated,  t'se  of  the  LCTV  allows  a  convenient  way  of  testing 
this  system. 
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INNER-PRODUCT  OPTICAL  NEURAL  PROCESSING  AND  SUPERVISED  LEARNING. 
Hua-Kuang  Liu.  Tien-Hsin  Chao  and  Jacob  Barhen  California  Institute  of 
Technology/Jet  Propulsion  Laboratory,  Pasadena,  CA  91109  and  Graf  Bittner 
Department  of  Electrical  and  Computer  Engineering,  University  of  California  at 
San  Diego,  La  Jolla,  CA  92093 

It  has  been  discovered  that  an  inner-product  approach  [1.2]  to  artifical  neural 
network  (ANN)  computations  is  not  only  very  suitable  for  optical 
implementation  but  also  superior  algorithmically.  This  is  because,  for  a  large 
class  of  applications,  the  storage  space  needed  is  about  an  order  of  magnitude 
smaller  compared  to  that  of  the  outer-product  approach.  Moreover,  the 
pre-calculation  of  the  outer-product  interconnection  matrix  is  not  needed. 
Hence  there  is  no  saturation  of  the  synapses  problem  in  the  hardware 
associated  with  the  interconnection  matrix. 

For  a  compairson  between  the  inner-  and  outer-product  approaches  with 
regard  to  speed  of  convergence  and  false  states,  we  have  used  computer 
simulation  to  study  the  corresponding  basins  of  attraction.  As  a  typical 
example,  in  an  exhaustive  search  mode,  we  have  limited  our  number  of  neurons 
to  16  and  thus  the  number  of  input  states  is  65536.  We  have  randomly  selected 
up  to  4  of  the  65536  possible  vectors  and  stored  them  in  the  memory  and  used 
all  65536  states  to  associatively  retrieve  the  output  both  with  the  inner-  and 
outer-product  approaches.  We  have  made  the  diagonal  terms  of  the 
outer-product  equal  to  zero  and  not-equal  to  zero.  The  computations  have  been 
performed  for  both  using  the  unipolar  and  bipolar  vectors.  In  the  unipolar  case, 
an  adaptative  thresholding  method  is  used.  The  statistical  results  show  the 
histogram  of  stable  states  with  respect  to  the  Hamming  distances  between  the 
input  and  output  and  convergence  of  the  stabalized  output  versus  the  number  of 
iterations.  Based  on  these  preliminary  results,  it  seems  that  the  inner-product 
approach  may  have  a  lesser  number  of  spurious  states  and  converge  faster.  The 
other  characteristics  are  similar  for  the  two  approaches.  We  have  also 
investigated  the  aspect  of  learning  in  the  inner-product  approach.  A  supervised 
learning  scheme  can  be  realized  in  the  inner-product  approach  by  directly 
adding  or  removing  vectors  from  the  memory  or  by  revising  the  memory.  This 
can  also  be  done  conveniently  in  our  optical  implementations.  The  synapses 
that  are  not  explicitly  shown  in  the  inner-product  approach  may  be  considered 
as  hidden  in  the  architecture.  The  parallelism  and  speed  of-light 
multiplication  and  summation  advantages  are  fully  utilized  in  this  approach 
implementing  the  ANN. 
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Predetection  dynamic  range  compression  is  important  in 
solving  the  problem  where  the  input  image  has  such  a  high 
dynamic  range  that  no  detectors  or  sensors  can  record  the 
complete  intensity  range  of  the  image  without  saturation. 
An  example  is  in  the  detection  of  a  scene  with  a  shiny  auto¬ 
mobile  or  an  aluminum  building  under  strong  solar  illumina¬ 
tion  in  a  background  of  low  reflectance.  Similar  IR  scenes  of 
military  or  industrial  interests  also  pose  a  problem  for  image 
recording  and/or  data  acquisition.  To  our  knowledge,  no 
other  means  for  solving  this  problem,  including  the  one 
proposed  here,*  has  been  reported  in  the  literature. 

In  this  Letter,  we  describe  a  new  concept  using  the  photo- 
refractive  cryst^  for  real-time  predetection  dtmamic  range 
compression.  'Hiis  idea,  in  principle,  is  opposite  to  the  idea 
of  using  photorefractive  crystals  for  amplification,^  In  our 
idea,  the  nonlinear  dependence  of  the  gain  coefficient  on 
intensity  is  not  only  desirable  but  also  necessary.  Experi¬ 
mental  results  from  a  study  of  the  two-wave  mixing  in  GaAs 
crystals**  at  1.1b  pm  are  presented  to  demonsuate  the  feasi¬ 
bility  of  the  idea. 

First,  we  present  the  basic  idea  of  predetection  dynamic 
range  compression.  The  dynamic  range  (DRi  of  an  input 
image  may  be  defined  as  follows; 

DR  -  W/«..  (1) 

where  Imus  end  /oia  represent  the  maximum  and  minimum 
intensities  of  the  input  image.  Before  the  image  is  received 
at  the  detector,  a  device  may  be  used  to  map  the  input  image 
into  an  output  image  in  the  following  functional  form: 

u-mj.  (2) 

where  /  is  a  function  of  mapping,  /la  and  vn  the  input  and 
output  intensities,  respectively.  All  the  intensities  may  be 
in  l-or2-Dform.  Tlie  fbnetion  /  represents  the  operational 
characteristics  of  the  device.  For  example,  we  may  write 

where  A  is  a  constant  and  X  is  an  index  number.  Whenx>l 
and  A  <  1,  the  device  acts  as  a  linear  absorber.  When  x  *  1 
and  A  >1,  the  device  acu  as  a  linear  amplifier.  Whenx>l, 
it  acts  as  a  nonlinear  amplifiw.  When  z  <  1,  it  can  achieve 
DR  compreasion.  because  intensity  reduction  at  brighur 
spou  is  larger  than  Umt  at  weaker  ones.  The  essence  of  DR 
compression  is  to  find  a  device  with  a  characteristic  f  so  that  f 
will  cause 
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Fig.  1.  Predetection  dynamic  range  compreMion.  The  upper  part 
of  the  figure  shows  the  characteristic  of  a  detector  or  a  sensor  with 
the  (viginal  range  of  inputs  and  iu  saturation  effect.  The  com- 
piessed  range  of  the  output  is  shown  in  the  lower  part 

DR  (output)  <  DR  (input).  (3) 

The  idea  and  its  usefulness  can  be  illustrated  with  the  assis¬ 
tance  of  Pig.  1.  The  upper  part  of  the  figure  shows  the 
characteristic  of  a  typie^  detector,  such  as  a  photographic 
film  with  a  limited  detection  range.  If  the  input  intensity 
range  is  too  large  for  the  detector's  detection  range,  satura¬ 
tion  occurs  as  ^own.  After  predetection  DR  compression, 
this  saturation  problem  is  avoided.  Since  there  is  still  a  one- 
to-one  correspondence  in  terms  of  the  input  details,  the 
information  capacity  is  kept  intact  in  this  process. 

Next,  we  describe  how  the  two-wave  mixing  (beam  cou¬ 
pling)  scheme  can  be  used  to  compress  the  DR  of  an  input 
image.  It  is  well  known  that  during  the  two-wave  mixing 
process  in  a  photorefractive  crystal,  one  beam  can  gain  ener¬ 
gy  at  the  expense  of  the  other.*  This  effect  can  be  used  for 
DR  compreasion  provided  the  fraction  of  energy  transferred 
increases  with  intensity.  This  particular  phenomenon  was 
recently  observed  in  our  experiment  measuring  intensity 
depeiodiBnce  of  the  beam  coupling  coefficient  in  GaAs.^  The 
result  shoe's  that  the  measured  coefficient  increases  approxi¬ 
mately  with  the  logarithm  of  beam  intensity  within  the  ex¬ 
perimental  intensity  range. 

A  conceptual  DR  compression  device  utilizing  the  photor¬ 
efractive  effect  is  shown  in  Fig.  2.  The  input  bram  I m  is  split 
into  two  equal  intensity  beams,  /jni  and  Im,  at  the  beam 
splitter  (BS).  Then  the  two  beams  exchange  energy  through 
two*vmve  mixing  in  the  GaAs  crystal.  The  output  beam  that 
lost  energy  is  represented  by  /omi,  end  the  one  that  gain^ 
energy  is  represented  by /omz-  It  can  be  shown*  that  the  gain 
coefficient  F  may  be  written  as 

r  -  (\tZ) 

where  Z  is  the  crytui  thickness.  Assuming/iai  >  Im  * 
we  obtain 
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Fig.  2.  Diagram  depicting  a  conceptual  DR  compression  device 
using  two-wave  mixing  in  a  photorefractive  crystal. 


Fig.  3.  Experimental  data  demorMtrating  the  feasibility  of  DR 
compression  relationship  based  on  Eq.  (5)  and  the  GaAs  experimen¬ 
tal  data. 


expi-rZl.  (3> 

The  results  of  experiments  by  Cheni  and  Partovi^  have 
revealed  that  T  increases  with  lofarithm  of  beam  intensity 
and  the  rate  of  the  increase  reduces  when  /jai  and  are 
larger  than  10  mW/cm^.  Using  the  experimental  data,  we 
have  calculated  the  output  values  of  a  conceptual  GaAs 
photorefractive  DR  compressor  based  on  Eq.  (5).  The  re* 
sulu.  as  shown  in  Fig.  3.  clearly  indicate  that  DR  compres¬ 
sion  occurs.  The  effect  is  more  revealing  when  the  product 
of  the  gain  and  crystal  thickness  TZ  is  greater.  For  example, 
the  compression  factor  is  <>10  when  the  product  is  -~2:  this  is 
achievable  by  applying  an  electric  field. 

In  our  experiment,  the  maximum  measured  value  of  P  wu 
only  '>0.21  cm~‘  at  100  mW/cm^  of  a  1.15-Mm  laser  beam. 
However,  if  an  electric  field  was  applied  to  the  GaAs.  a  \ 
value  of0.9cm~^  was  reported.*  Further  improvement  to ->7 
cm~  ‘  is  still  poasible.'  With  the  improved  gain  coefTicient.  a 
crystal  of  0.3-cm  thickness  that  is  viable  for  a  device  could 
offer  signiHcant  DR  compression.  However,  an  effective 
demonstration  of  the  proposed  dynamic  range  reduction 
concept  using  the  photorefractive  effect  has  to  be  delayed 
until  either  a  successful  achievement  in  the  coupling  coeffi¬ 
cient  improvement  in  GaAs  or  a  discovery  of  a  new  photore¬ 
fractive  material  having  a  similar  nonlinear  property  but 
with  a  large  coupling  coefficient 

It  should  be  noted  that  light  absorption  in  the  crystal  is 
neglected  in  Eq.  (9).  This  does  not  affbet  the  purpose  of  this 
Letter,  the  demonstration  of  the  DR  compression  concept 
However,  light  absorption  can  reduce  /wti  by  a  constant 
factor. 

The  research  described  in  this  paper  was  performed  at  the 
-Jet  Propulsion  Laboratory  and  jointly  supported  by  the  De¬ 
fense  Advanced  Research  Projects  Agency,  the  Strategic  De¬ 
fense  Initiative  Organization,  the  Physics  Division  of  the 
U.S.  Army  Research  Office,  and  the  National  Aeronautics 
and  Space  .Administration. 
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This  Letter  concerns  the  imaging  of  3-D  objects  in  optical 
systems  using  diffraction  gratings. 

It  can  easily  be  seen  experimentally  that  when  one  ob¬ 
serves  a  3-D  scene  through  a  diffraction  grating,  the  objects 
appear  symmetrically  replicated  with  respect  to  the  ordinary 
(zero-order)  image.  As  chromatic  dispersion  affects  the  im¬ 
age.  a  monochromatic  source  is  used.  Careful  observation 
shows  that  closer  objecu  produce  twin  images  that  are  less 
separated  than  far  away  objects,  and  separation  as  a  function 
of  the  disunce  reaches  saturation  (i.e..  the  twin  images  pro¬ 
duced  by  the  stars  do  not  seem  to  be  separated  much  more 
than  those  due  to  an  object  several  meters  away  from  the 
observer). 

This  ezperiment  suggests  that  by  calibrating  the  disunces 
between  diHracted  orders  with  the  actual  distances  to  the 
corresponding  objects,  a  simple  telemeter  could  be  designed. 
It  would  be  so.  at  least  in  principle,  but  as  a  practical  instru¬ 
ment  it  would  have  severad  shortcomings.  For  ezample,  for 
more  or  less  accurate  measurement  of  the  distances  between 
points  of  the  twin  images,  the  object  should  have  abrupt 
luminance  discontinuities.  Besides,  such  distances  change 
with  eye-grating  distance,  complicating  the  measurement 
even  more. 

Figure  t  is  a  photograph  of  a  straight  line  luminous  object, 
the  points  of  which  recede  from  the  observer,  as  seen  through 
a  diHraction  grating.  Only  the  zero  and  the  first  diffracted 
orders  are  shown.  It  can  be  seen  that  the  distance  between 
homologous  points  on  the  diffracted  orders  to  the  zero  order 
increases  with  the  (iistance  to  the  observer  in  approzimately 
linear  fashion. 

•A  careful  analysis  involving  diffraction  theory  shows  that 
the  image  of  a  point  source  through  a  system,  such  as  that 
depicted  in  Fig.  2.  is  described  by‘ 
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Abattact 

A  brief  review  of  optical  iaage  subtraction  techniques  recently  developed  is  presented. 
Me  have  divided  thee  into  two  categories  according  to  whether  they  can  or  cannot  be 
performed  in  real  time. 


Xattadufitian 

Optical  image  subtraction  (OIS)  techniques^  ace  very  useful  in  many  areas  such  as  earth 
resources  studies,  meteorology,  automatic  surveillance,  pattern  recognition,  urban  growth 
studies,  and  bandwidth  compression  In  communication  systems.  An  earlier  review  paper 
written  by  John  F.  Bbersole^  has  covered  many  optical  subtraction  techniques  up  to  1975.  It 
is  the  purpose  of  this  paper  to  present  a  brief  review  of  many  OIS  techniques  developed 
since  then. 

Proa  an  application  standpoint,  we  classify  the  OIS  techniques  into  two  groups, 
depending  on  whether  or  not  they  can  be  operated  in  real  tine.  A  Table  listing  the 
techniques,  with  proper  references,  is  given  for  the  reader's  convenience.  Because  of  the 
extensive  amount  of  literature  on  OIS,  we  night  not  have  included  then  all  in  this  article. 


The  real-time  OIS  techniques  are  generally  realised  through  the  holographic  and 
interferometric  methods.  In  an  experimental  process  typically  involving  the  use  of  two 
stored  scenes  recorded  on  either  photographic  films  or  real-time  recording  devices  such  as  a 
•ii2^^20  crystal,  the  input  objects  are  illuminated  either  a  coherent  or 

incoherent  light  source.  Shearing  devices  such  as  gratings-’,  Wollaston  prisms,  and 
holographic  shear  lenses  may  be  used  to  shear  the  two  input  objects  and  recombine  them  in 
the  output  plane.  A  ir-radian  phase  change  is  introduced  between  the  two  light  paths  passed 
through  by  the  two  output  images  and  thus  the  optical  interference  can  eliminate  the  common 
background,  and  only  the  difference  iaage  will  be  seen  in  the  output  plane. 

anuree  eneodtno 

A  source  encoding  technigue  will  perform  iaage  subtraction  with  an  extended  quasi- 
aonochromatic  light  source*'^  as  shown  in  Figure  1.  A  1-D  mask  consisting  of  a  periodic 
array  of  narrow  slits  with  slit  width  d  and  nearest  neighbor  separation  D  is  used  to  create 
a  high  degree  of  spatial  coherence  between  any  pair  of  points  (at  the  input  plane  P?)  that 
are  separated  by  ^x  ■  n(Xf/0),  where  n  is  an  integer,  X  is  the  wavelength  of  the  light 
source,  and  f  is  the  focal  length  of  the  transform  lenses.  Following  the  Van-Citter  Zernike 
theorem,  the  spatial  cobetence  function  in  the  input  plane  is  the  normalized  Fourier 
transform  of  the  mask  intensity  transmittance  function  as  shown  in  Figure  2.  If  h.  is 
selected  to  be  Xf/D,  and  the  ratio  of  d/0  is  1/10,  the  spatial  coherence  of  any  point-pair 
separated  by  a  distance  of  2h-  is  about  0.930.  The  spatial  coherence  can  further  be 
increased  through  the  use  of  a  narrower  slit.  A  sinusoidal  diffraction  grating  it  inserted 
into  the  Fourier  plane  P3.  The  grating  period  is  chosen  to  match  that  of  the  encoding  mask. 
The  grating  will  recoabina  the  input  iaage  ttansparenciea  81  and  89  at  the  output  plane  P4 
with  a  w-phase  difference.  Thua  a  high  quality  diffecance  image  can  be  obtained. 

This  source  encoding  technique  can  also  ba  extended  to  white-light  image  subtraction*. 

As  shown  in  Figure  3,  a  fan-shaped  sneoding  mask  is  lllusiinated  by  a  rainbow  spectrum 
dispersed  by  a  volume  grating  using  a  white-light  extended  source.  The  scale  of  the  fan¬ 
shaped  mask  varies  linearly  to  acecainodate  the  wavelength  variation.  The  diffraction 
grating  used  in  the  Fourier  plane  is  also  modified  into  a  matching  fan-shape.  This^hite- 
light  iaage  subtraction  systaa  is  particularly  suitable  for  color  signal  processing'. 

The  basic  principle  of  polarisation  modulation  oil  say  be  illustrated  in  Figure  4(a).  a 
coherent  plane  wave  is  utilised  to  illuminate  the  two  input  objects  81  and  83  through  the 
polarizers  F.  and  Fj,  respectively.  81  and  89  ace  separated  by  a  distance  x.  from  the 
optical  axis.  As  a  result  of  polarisation  aeclulation,  the  polarisation  of  tne  distribution 
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riguc*  2.  Spatial  cobacanca  function  ccaatad  by  a  aoucca  ancodins  naak 

innadiataly  batoind  Si  and  §2  atata  is  at  a  fO^  diffaranea.  At  tba  back  focal  plana  of  tha 
Pouriac  tranafoca  Ians  Li#  a  bicafcinsant  Vollaaton  pcisa  is  insactad  which  daflacts  tha 
lisht  baaas  passins  thcough  it  accocdins  to  tha  polaciaation  atata.  Tha  daflaction  an^las 
ara  aqual  but  at  opposita  diraetion  auch  that  tba  iaasa  of  St  and  89  can  ba  racoabinad  at 
tba  outMt  plana.  A  cotatabla  analysac  is  placad  in  front  of  Ians  1.2.  As  tba  analysat  is 
adjustad  by  a  ccossad-Sicol  saoaatcy,  as  shown  in  tha  vactot  diasraa  of  Pisuca  4(b), 
w  '•pbaaa  shift  batwaan  S,  and  Sj  can  ba  obtainad  and  banca  iaasa  subtraction  can  ba 
acbiavad. 

Paatidooolor  taaaa-dtf  Paranea  SafetlaB 

Tha  polarisation  nodulation  tachniqua  can  ba  astandad  for  datactins  iaaga  diffarancas 
throusb  paaudoeolor  ancodinq*'^^,  so  shown  in  Piqura  5.  A  pair  of  input  objaets  S^  and  S2 
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Figure  S.  Real-tine  white-light  inage-difference  detection  ayaten 

indicating  the  difference  between  S|  and  S2«  In  the  preaent  caae,  the  red  color  shows  the  { 

portion  where  the  transnittance  S2  la  greater  than  that  of  St  and  vice  versa  for  the  green. 

The  yellow  shows  the  identical  portion  of  and  S2>  It  a  colornetric  detector  is  used  to 
scan  the  output,  the  differences  in  the  inage  can  t>e  found.^*’ 

Holoatanhie  ahaac  lens  teehnioua 

The  holographic  shear  lens  OXS  technigue^^  is  a  nodification  of  the  diffraction  grating 
nethod^.  As  shown  in  Figure  6,  two  photographic  inage  transparencies  St  and  S2  are  inserted  I 
into  the  input  plane  of  the  coherent  inage  subtraction  systen.  A  specially  fabricated 
holograhic  shear  lens  is  inserted  into  the  Fourier  plane.  The  holographic  lens  shears  and 
reconbines  the  inages  St  and  S2  at  the  output  plane.  The  holographic  shear  lens  is 
synthesised  by  the  superposition  of  two  Fresnel  sone  plates  with  carrier  frequencies  I 

separated  by  Au«  This  shear  lens  is  sinilar  to  the  double  frequency  grating  used  in  i 

ahearing-interferonetry.  In  perforning  the  inage  subtraction,  the  shear  lens  is  tilted  at  a  ' 
suitable  angle  such  that  the  light  path  traveled  by  the  two  input  inages  is  differ^  by  '"'/I 
and  so  that  the  subtraction  between  the  inage  can  be  obtained.  A  sinilar  approach^^  I 

utilizing  a  double-grating  shearing  intetferoneter  to  shear,  and  introducing  7r-radian  phase  I 
change  between  a  pair  of  input  transparencies  has  also  been  proposed. 
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Figure  6.  A  set-up  of  real-tine  inage  subtraction  systen  using  holographic  shear  lens 
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(taal-tiaa  OIS  can  also  ba  achiaved  by  holographic  two-wava  or  four-wava  mixing  (PHN) 
tachniquaa  using  nonlinaar  alactro-optics  crystals  such  as  tha  photoref ractiva  B1i2Q*02q 
(BGO)  crystal^^.  Tha  sat-up  of  a  FNM  through  a  raflaction  hologram  for  imago  subtraction  is 
shown  in  Figura  7(a).  Tha  raflaction  hologram  is  formad  by  racoding  tha  intarferanca 
pattarn  batwaan  tha  objacts  baam  and  tafaranca  baam  A^  that  aca  on  tha  opposita  sida  of 
tha  BGO  crystal.  Tha  crystallographic  axis  normal  to  tha  crystal  surfaca  is  oriantad 
parallal  to  tha  bisactor  of  tha  tafaranca  baam  and  tha  objact  baam.  A  pariodic  spaca-charge 
elactric  fiald  is  ganaratad  which  modulatas  tha  rafractiva  indax  of  tha  crystal.  A  phase 
volume  raflaction  hologram  is  formad  inside  tha  crystal.  Tha  reading  beam  A^  can  than 
reconstruct  tha  objact  beam  Ap  which  travels  to  tha  opposite  direction  of  Ag.  A  beam 
splitter  is  inserted  into  ths  light  path  of  A-  and  forms  a  real  image  of  the  object  that  can 
be  picked  up  by  a  TV  camera  and  displayed  on  t  TV  monitor. 

Application  of  this  technique  is  similar  to  that  of  a  doubla-axposure  holographic 
subtraction  tachniquat  a  phase-shift  is  introduced  into  tha  refarenca  beam  A.  by  translating 
the  piasomirrot  a  distance  X/4  batwaan  tha  racording  of  tha  first  and  second  holographic 
images.  Oua  to  tha  alow  raaponaa  and  tha  erase  time  of  BGO  as  shown  in  Figura  7(b),  the  two 
images  can  both  exist  for  a  short  time  interval  r,  during  which  tha  difference  image  can  be 
shown  on  tha  monitor  screen. 


Figura  7.  >asl-tlM  isMga  subtrsetiem  in  fouc-wava  mlslng  with  photoref ractiva 
■liiOaOiA  etystal 
(at  •yaCaa  aehaaatle  dlagcaa 

(h)  haoocdlnf-araaura  eyela  of  bologtapble  racording  in  BOO  crystal 


Ocaor  aiaocse-upcxoa  dwvloaa  Mat  nave  Ofon  uaod  an  opci^l  image  suetraction  include 
tha  lughos  Llauid  Crystal  Light  Valva  (LOAr)***  Poekal  Call^’  and  channel  plate  image 
intansifiar.** 
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Non-ceal-tlm*  OIS  tachnlquat  ac«  generally  achieved  through  optical  encoding.  The  image 
transparency  Si  is  imaged  through  an  encoding  mechanism  which  modulates  the  output  image  of 
S]  by  a  1-D  (possibly  periodic)  pattern.  The  coding  mechanism  is  then  aligned  such  that  the 
modulating  pattern  is  shifted  by  half  a  period  and  an  exposure  of  the  second  transparency  $2 
is  taken.  For  example^  if  the  coding  pattern  is  a  cosinusoidal  grating,  the  resultant  codec 
image  transmittance  t(x,y)  of  the  developed  film  may  be  written  as  follows: 

T(x,y)  •  SjCx.y)  114-cos  (2  irf^x)] 

4-82  (x,y)  1 1-cos (2  irf^x)! , 

where  f„  is  the  spatial  frequency  of  the  grating.  The  coded  film  is  then  placed  at  the 
image  plane  of  a  4-f  optical  processor  and  a  band-pass  binary  filter  is  placed  at  the 
Fourier  plane.  The  first  order  of  the  image  spectrum  can  be  selected  and  the  difference 
image  therefore  appears  at  the  output  plane. 


This  method  utilises  the  multiple  imaging  effect  of  a  photographic  diffuser^^  produced 
by  photographic  recording  of  a  fine  speckle  psttern  with  the  optical  set-up  shown  in  Figure 
8.  The  very  coarse  grid  (Ronchi  ruling)  6  is  illuminated  by  a  quasi-monochromatic  diffused 
light  using  a  tungatun  lamp  S  in  conjunction  with  a  bandpass  spectral  filter  F  and  a  ground 
glass.  The  random  diffuser  is  placed  at  a  distance  >1  from  the  grating,  and  the  imaging 
plane  F2  located  at  a  distance  <2  diffuser.  The  diffuser  screen  acts  like  a 

two-dimensional  random  array  of  piioioles  with  each  pinhole  producing  its  own  discrete  image. 
The  magnification  factor  has  typical  values  on  the  order  of  2  x  10~*.  During 

encoding,  an  input  photographic  transparency  is  placed  at  the  multiple  imaging  plane  P2  in 
the  output  plane.  The  diffuser  screen  modulates  the  input  transparency  with  multiple 
demagnif  led  images.  A  relay  lens  is  utilised  to  project  the  encoded  image  in  plane  F2  to 
the  output  photographic  plate.  Between  the  two  exposures,  the  coarse  grid  is  translated  in 
its  plane  by  half  a  period.  The  extremely  high  demagnification  effect  of  the  speckle 
diffuser  allows  the  use  of  a  very  coarse  grating,  and  the  accuracy  of  the  -v-phase  shift  can 
be  increased  by  a  factor  equal  to  the  demagnif ieation  of  the  imaging  process. 


COAR8C 
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Figure  I.  IsMgs  subtraction  system  through  spseklo  diffuser  coding 

(a)  Bot-up  showino  multiple  imsgiog  by  diffuser 

(b)  Optical  recording  arrangsmsots 
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111*  ip«clcl«  patt«cn  coding  tschniqu*  ii  also  a  doubla-axposura  appcoacb^^'^^  which  is 
suitabla  foe  axteactinq  the  diffecances  between  both  2-  and  3-diaiensional  scenes.  Piqure  9 
shows  the  set-up  used  for  obtaining  the  differences  between  two  scenes.  A  3-D  diffusive 
object  (or  a  2-D  transparency  placed  behind  a  fine  diffuser)  is  illuainated  by  a 
aonochroaatic  light.  The  iaaging  lens  L  projects  the  3-D  scene  onto  the  output  photographic 
plane  through  an  encoding  aask  which  consists  of  two  circular  apertures.  The  output  iaages 
are  encoded  with  speckle- nodulated  Young's  fringes  hecause  of  the  liaited  size  of  the  pair 
of  circular  apertures.  The  ir-phase  shift  of  the  output  Young's  fringes  between  two 
exposures  was  obtained  by  inserting  a  parallel  glass  plate  between  the  encoding  aask  and  the 


(b) 


DIFFERENCE 

IMAGE 


Figure  9.  Optical  iaage  subtraction  through  speckle  pattern  nodulated  by  Young's  fringes 

(a)  Oouble-exposura  caoordlng  set-up 

(b)  Keeonstcuctloa  set-up 

output  plane.  During  the  second  exposure*  the  plate  is  adjusted  by  a  pre-deterained  angle  ^ 
froa  its  position  at  the  first  exposure.  The  iaage  difference  can  be  obtained  by  spatial 
filtering  of  the  encoded  photographic  iaage. 


The  halftone  screen  encoding  nethod^^'^^  is  a  three-step  aethod.  The  first  step  is  to 
prepare  the  halftone  negatiwes  ti.  and  Sjn  for  the  input  photographic  transparencies  Si  and 
82*  respectively.  Bach  of  the  two  iaages  is  contaet-printed  through  a  1-0  halftone  contact 
screen  of  spetial  period  x  onto  a  high-contrast  nsgstive  fila.  During  the  preparation  of 
the  halftone  negatives  81.  and  8211  the  exposure  co^itions  are  the  sane*  and  the  contact 
screen  is  fixed  in  a  position  reXativs  to  botn  scenes  81  and  83.  The  second  step  is  to 
prepsre  the  halftone  positives  81.  and  By-  which  can  be  done  by  dlrect-contact-printing 
and  8211  onto  fresh  high-gaaaa  ndgativss. 

The  intensity  transaittanee  profile  in  a  unit  cell  X  of  81-,  82^,  8]^-*  and  S^p 
repressnted  by  Tg^p*  *s2n'  *slp'  *s2p  Figure  10.  Tne  vsiue  of  fp  is 

8Wr  VH  «M  AvcMSyflSeS;  /  St 
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usually  gcaatac  than  0.85.  W-.  and  W,2n  *<c*  widths  of  tha  opaqua  bats,  and  H,np  and 

ara  tha  widths  ot  tha  transparant  Mrs  H>in'  **s1b'  ’*s2n'  ^a2e*  Gwnacally  shaking, 

ba^usa  oC  tha  thtasholding  affact  of  tha  high-gaaaa  nia,  tha  ralatldnship  batwaan  and 
Tgx  and  ifg2  ^s2  dascribad  as 

Wsi/*  -  *(»sl> '  •  *^*s2>* 

Finally,  tha  subtcaction  ~  ^  obtainad  by  suparposing  Sip  and  82^* 

Similacly,  supatposing  Si.  and  can  pcovida  tha  diCfaranca  ~£(T,i)  £(Ta2)*  in  tha  case 

o£  £(T.i)  -  tha  cantac  of  tna  opagua  bar  S^n  i*  anda  to  coincida  witn  that  of  tha 

transparant  spanng  of  Si.  as  shown  in  Figuca  11(a),  whara  aithar  W.2>Hg2  cc  f (T,i)>f (Tg2) 

18  assuaad.  Tha  tcansaitCanca  T,,  casulting  froB  tha  subttactions  A  tha  ragion  A  tha 


Si 


*2 


Figuca  10.  Tha  tcansaittanca  pcofllaa  of  tha  halftona  nagativas  and  halftona  positivas 
of  two  iaagas  S^  and  82 


Figura  11.  (a)  TranaBlttaiicas  of  half  ton*  pliotegrapbs  81  ^  and  8211 

(b)  TtanaBiktaoea  of  82p  supacposad  on  top  of  8211 

spacific  call  of  tha  halftona  pbotogcapb*  is  shewn  in  Figuca  11(b).  Tha  subtcaetad  valua 
can  ba  eutaioad  uy  aoaabcing  Tg. 
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In  9«n«cal,  ima9«  subtraction  can  also  ba  achiavad  throu9b  contact-printin9  encoder 
rulin9  usin9  rulin9  with  unequal  widths  in  its  opaque  and  transparent  bars.  It  has  been 
thaoratically  proven  that  the  use  of  such  a  qratlnq  does  not  alter  the  difference  between 
iaaqes.^^ 


Polariaation-ahifted  encoding 

The  encodinq  system  is  shown  in  Figure  12(a).  A  quasi-nonochromatic  source  S  is  imaged 
onto  a  pinhole  P  by  a  condensing  lens  n>e  light  passing  through  P  is  collimated  into  a 

plane  wave  by  the  lens  L2.  A  polar Iser  Pi  is  placed  between  the  sources  S  and  the  lens 
and  the  polarized  parallel  beam  illuminates  the  grating  G.  A  set  of  binary  polarization 
filters  H  is  inserted  in  the  back  focal  plane  of  the  lens  Lj  as  shown  in  Figure  12(b).  The 
filter  consists  of  two  mutually  orthogonal  polarizers,  each  of  which  transmits  one  of  the 
first  order  of  the  grating  spectrum.  The  transmission  axis  of  the  polarizers  in  filter  M 
makes  angles  of  ±  ir/4  with  that  of  the  polarizer  of  P^.  A  polarizer  P2  is  placed  at  the 
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(a) 


P(0)  P(»/2) 

(b) 


Figure  12.  Set-up  for  recording  the  modulated  images  using  polarization-shifted  spatial 
carrier 

(a)  System  set-up 

(b)  Binary  polarization  filter  N 


output  plane  of  the  grating  G  with  its  transmission  axis  inclined  to  both  polarizers  of  the 
filter  N.  A  photographic  transparency  placed  immediately  behind  the  polarizers  P2  viH  be 
nodulated  by  high-contrast  sinusoidal  fringes.  The  nodulated  transparency  is  imaged  by  lens 
1.5  onto  a  fresh  recording  fils. 

During  the  second  exposure  of  the  object  transparencies  Si  and  82*  the  polarizer  P^  is 
rotated  through  an  angle  of  v/2  such  that  the  encoding  sinusoidal  fringe  pattern  will  shift 
by  a  half  period.  The  difference  image  can  than  be  obtained  by  spatial  filtering. 


Cone lua Ion 

We  have  briefly  reviewed  the  state-of-the-art  of  most  of  the  OIS  techniques  developed 
during  the  last  decade.  For  clarity,  the  techniques  included  are  listed  in  Table  I.  The 
non-real-time  optical  techniques  are  important  because  sene  of  them  nay  be  applied  directly 
and  others  nay  be  converted  into  real-time  ones  through  the  use  of  advanced  real-time 
spatial  light  modulators  or  electro-optic  devices.  The  most  useful  techniques  should 
nevertheless  be  the  real-time  operations.  Since  optical  techniques  can  offer  true  amplitude 
subtraction  in  addition  to  the  parallel  no-need-of-conversion,  high-throughput 
characteristics,  their  importance  is  obvious.  Continued  development  of  coherent  optical 
subtraction  techniques  should  hence  be  of  interest  to  SASA,  OoO,  and  industry. 


The  research  described  in  this  paper  was  carried  out  by  the  Jet  Propulsion  Laboratory, 
California  Institute  of  Technology,  under  a  contract  with  the  National  Aeronautics  and  Space 
Administration.  We  wish  to  thank  C.  P.  Grover  for  helpful  discussions,  along  with  J.  Donato 
and  W.  Whitney  for  editorial  help. 
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TabI*  1.  Optical  laaga  Subtraction  Techniques 
(1975  -  1985) 


Aaplitude  (A) 

Light  Source 

Point  Source:  P 

or  Intensity  (I) 

N:  nonochronatic 

Slit  Source:  S 

Method 

Subtraction 

Q-Nt  quasi- 
nonochronatic 

HHi  white  light 

Extended  Source:  E 

RtAl-lias  OIS 

a. 

Source  encoding 

i 

! 

1-0  encoding  nask  (Ref.  4,5) 

A 

0-M 

E 

2-D  encoding  aask  (Ref.  6,7) 

A 

HH 

E 

j 

b. 

Polarisation  nodulation  (Ref.  8) 

A 

M 

P 

1 

i 

c. 

Pseudocolor  inage  difference 
detection  (Ref.  9,10) 

I 

WH 

E 

1 

d. 

Shearing  interferoaetric  aethods 
(Ref.  11,12) 

A 

H 

P 

, ! 

e. 

Electro-optics  aethod  (Ref.  13) 

A 

M 

P 

i 

! 

Mon- 

a. 

Speckle  diffuser  encoding  (Ref.  17) 

I 

Q-M 

E 

1 

b. 

Speckle  pattern  encoding  (Ref.  18,19) 

I 

N 

P 

,  / 

c. 

Halftone  screen  encoding  (Ref.  20,22) 

I 

HH 

E 

i 

d. 

Polarisation  shifted  carrier  encoding 
(Ref.  23,24) 

1 

0-N 

S 

! 

_ _ \ 
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1  Introductkm 

With  the  advent  <tfoptical/VLSI  technology,  memoiy  and  processing  power  is  becoming  very 
inexpensive  and  affixdable.  The  emphasis  of  optioJ/VISI  system  design  is  now  placed  on 
reducing  the  overall  interconnection  complexity  and  keeping  the  overall  architecture  highly 
regular,  paralld,  and  i^pdined.  The  feasibility  of  array  processors  based  on  optical/VLSI 
technology  enables  the  processing  speed  to  increase  several  orders  at  magnitude.  With 
<qitical/VI.Sl  it  becomes  fsaaihle  to  construct  an  array  processor  which  dosdy  resembles 
the  ikiw  graph  corresponding  to  the  algorithm  of  interest.  These  arrays  maximize  the 
strength  of  optical/VLSI  in  terms  of  intensive  and  pipdined  computing  and  yet  circumvent 
its  main  limitation  on  communication.  There  are  four  main  points  of  attack  in  an  inte¬ 
grated  optical/VLSI  system  design  methodology:  teehnologjf,  applkution»,  algoritiunt,  and 
arehitectmru  [18]. 

In  this  proj^,  we  have  adopted  a  systematic  moping  n^hodology,  based  on  the  use 
of  (data)  depanianea  pragh  (DG),  to  devdop  a  number  of  array  architectures  suitable  for 
optical/VLSI  (or  a  hybrid  design)  for  image  processing  and  a;^ysis  [18].  The  following 
snmmariass  semml  example  arddtectures  developed  in  this  project. 

Image  proressing  deals  with  deterministic  and  stochastic  representation  of  inuges  (im- 
agu  transforms  and  models),  compression  of  the  large  amount  of  data  in  the  images  (image 
data  compression),  and  improving  the  quality  of  the  image  Iqr  filtering  and  by  removing  any 
degradatim  present  (image  enhancement  and  restoration).  The  main  areas  in  digital  im¬ 
age  processing  are  cwhencemenf,  rutotaHon,  reeonatnietion  and  codtnf.  The  derived  array 
architectures  in  image  processing  are  presented  in  the  following  sections: 

Sectionfi:  Arr^  architectures  for  edge  detection  foature  extraction,  and  for  median/rank- 
order  filtering  umd  in  image  enhancement  [12]. 
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S«ction  3:  Array  architectures  using  artificial  neural  networks  (ANNs)  for  image 
restoration  and  pattern  recognition  [18]. 

Section  4:  Array  architectures  for  Kalman  filtering  for  least  squares  image  restora¬ 
tion/reconstruction  [13]. 

Below  a  brief  introduction  to  the  mapping  methodt^ogy  used  to  derive  the  array  ar¬ 
chitectures  is  given. 

1.1  Mapping  Algorithms  to  Broadcasting  SFGs 

The  main  concern  in  algorithm-oriented  array  processor  design  is:  ptuen  an  algorithm, 
how  is  an  array  proeestor  rytUmoHcally  dtrwedt  A  fundamental  issue  is  how  to  express 
parallel  algorithms  in  a  notation  which  is  easy  to  understand  by  humans  and  possible  to 
compile  into  efficient  optical/VLSI  array  processors.  The  ultimate  design  should  begin 
with  a  powerful  algorithmic  notation  to  express  the  recurrence  and  parallelism  associated 
with  the  description  of  the  space-time  activities.  Next,  this  description  will  be  converted 
into  a  optical/VLSI  hardware  description,  or  into  executable  array  processor  machine  codes. 

To  derive  an  SFG  array  for  a  given  algorithm,  we  can  divide  the  design  process  into 
two  stages  [18]: 

1.  Deriving  a  local  data  dependence  gr^h  (DG)  firom  the  given  algorithm. 

2.  Moping  the  DG  onto  a  signal  flow  graph  (SFG)  array  by  projection. 

Figure  1  sketches  the  two  levds  in  such  a  design  process. 

1.1.1  Stage  1:  Dependence  Graph  (DG)  Design 

A  (data)  dependence  gng>h  (DG)  is  a  directed  graph  which  specifies  the  data  dependencies 
of  an  algorithm.  In  a  DG,  nodes  represent  computations,  and  arcs  specify  the  data  de- 
pendaides  between  CMnpntatkms.  In  onr  notation,  with  respect  to  a  dependence  arc,  the 
terminating  node  depend  on  the  initiating  node.  Fkom  the  initial  sequential  algorithm  de¬ 
scription,  a  DG  for  the  algocitlim  can  be  derived  by  first  cemverting  the  algorithm  to  a  single 
assignment  form,  in  which  the  value  of  any  variable  is  asrigued  only  once  in  the  algorithm. 
A  single  assignment  form  can  clearly  show  the  data  dependencies  in  the  algorithm. 

Fot  many  legnlar  and  recursive  algorithms  we  are  interested  in,  the  DGs  are  very  Ukely 
to  be  shift-inmriant  or  homogeneous.  A  DG  is  shifl-inoariant  (SI)  if  the  dependence  arcs 
corresponding  to  oil  the  nodes  in  the  index  space  do  not  change  with  respect  to  the  node 
positioas.  In  this  case,  the  nodes  in  the  DG  can  be  embedded  in  an  index  space;  therefore, 
the  nodes  can  be  specified  by  simide  indices,  such  as  («,  j,  k).  An  edge  in  the  DG  can 
be  specified  by  the  index  diiforence  of  the  two  nodes  it  connects.  For  a  SI  DG,  the  edges 
can  be  rim^y  represented  by  a  small  set  of  dependence  vectors,  each  of  which  specifies  the 
index  difference  associated  with  the  edge. 
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Figure  1:  Diffefent  levck  in  dengning  SFG  errayt. 


A  eanonieal  mapping  methodologg  i«  ored  for  mapping  SI  DGs  onto  procesaor  arrays. 
Before  we  can  the  SI  DG,  we  first  localize  the  dependece  edges,  since  long  communi¬ 
cation  links  are  to  be  avoided  in  optical/VLSI  systems. 

Loesdiaed  DGs 

The  recursive  algorithms,  as  popularly  adopted,  are  usually  not  directly  given  in  a 
localized  form.  A  nonlocalized  lecnisive  algorithm,  when  mapped  onto  an  array  processor, 
is  likely  to  result  in  an  array  with  global  interconnections.  Although,  in  certain  instances, 
such  i^obal  arcs  can  be  avoided  by  using  a  proper  projection  direction  in  the  mapping 
schemes.  To  guarantee  a  locally  interconnected  array,  a  localized  recursive  algorithm  and, 
equivalently,  a  localized  DG  would  be  derived.  Most  existing  approaches  to  deriving  locally 
recursive  algorithms  are  rather  heuristic.  In  the  following,  a  more  formal  (but  admittedly 
still  somewhat  heuristic)  strategy  is  proposed. 

Broadeaat  Data:  U  a  variable  is  to  be  broadcast,  then  there  exists,  a  corresponding 
set  of  index  pdnts  on  which  the  same  data  value  repeatedly  appears.  This  set  is  termed 
a  broaddui  contow.  The  data  are  called  kroadcaii  data.  A  DG  may  contain  a  number  of 
such  broadcast  contours. 

TnmmitUnt  Data:  The  key  pmnt  is  that  instead  of  broadcasting  the  (public)  data 
along  a  ^bal  arc,  thesamedatamay  be  propopoted  via  local  arcs  and  thus  become  tranamiU 
tent  data.  By  replacing  the  broadcast  contours  by  local  arcs,  a  global  DG,  can  be  converted 
to  a  localized  version.  This  is  demonstrated  by  the  frdknving  examine. 
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Example:  DG  for  Convolution 

The  problem  of  convolution  is  defined  as  follows:  Given  two  sequences  u(J)  and  iv(j), 
j  =  0,  1,. N  -  I,  the  convolution  of  the  two  sequences  is 

»(i)  =  tt(fc)tD(i  -  *) 

kmO 

or 

) 

Vi  = 

kmO 

where  j  =  0,1,. .  ^N-2 

The  first  step  of  deriving  the  recursive  equation  is  to  introduce  a  recursive  variable  yj. 
Then  the  convolution  equation  can  be  rewritten  in  terms  of  a  recursive  form: 

(1) 

for  J ■  =  0,  1,. . JV  -  1,  and  *  =  0,  1,. . j  and  for  j  =  N,  N  +  I,  2N  -  2,  and  k  s= 
i-iv  +  ij  Ar  +  2,...,  Jv-1 

Note  that  Eq.  1  is  already  in  a  single  assignment  form;  therefore,  the  DG  can  be 
readily  sketched,  as  shown  in  Figure  2(a).  Equation  1  is  an  expression  with  global  data 
dependencies  and  it  is  therefore  not  a  locally  recursive  algorithm. 

By  replacing  the  broadcast  contours  by  local  arcs,  the  (global)  DG,  as  shown  in  Fig¬ 
ure  2(a),  can  be  easily  converted  to  a  locidised  version  as  shown  in  Figure  2(b),  which 
obviously  performs  the  same  algorithm.  The  localized  DG  has  a  corresponding  locally 
recursive  single  assignment  code; 

9^  =  =  0 

*}  =  «*_i  ,  uj  = 

=  vjZi  ,  =  Wi-* 

for  y  =  0,  1,. . .,  JV  -  1,  and  h  s  0,  1,. . .,  j  and  for  j  =  JV,  AT  -j- 1,  . . .,  2iV  -  2,  and  ik  = 
j- N  +  1J  N  +  2,..^N  ’-I 

1.1.2  Stsige  2:  SFG  Amy  Design 

To  determine  a  valid  array  structure  for  a  SI  local  DG,  one  straightforward  design  method 
is  to  designate  one  ptocesdng  dement  (PE)  for  each  node  in  a  DG.  This  however  in  general 
leads  to  very  inefficient  utilisation  of  the  PEs,  since  each  PE  can  be  active  only  for  a  small 
fraction  of  the  computation  time.  In  order  to  improve  PE  utilization,  it  is  often  desirable 

4 


340 


1 

I 

I 

I 

I 

1 

j 


k 

«(3)  - 
«(J)  - 
0(1)  - 


u(0) 

w(0)w(l)  w(2)w(S) 


(*) 


Figure  2:  DGa  for  convolutioii:  (k)  global;  (b)  localised. 


to  map  the  nodes  of  the  DG  onto  a  fewer  nnmber  of  PEs.  To  achieve  this  it  is  useful  to 
map  the  DG  first  to  an  intermediate  expression,  i.e.,  in  a  SFG  form. 

SFG  Arrays 

The  SFG  expresuon,  which  coi^ts  of  processing  rtodes,  communicating  edpes,  and 
delays.  In  general,  a  node  is  often  denoted  by  a  drde  representing  an  arithmetic  or  logic 
function  performed  with  zero  delay,  such  as  multiply  or,  add.  An  edge,  on  the  other  hand, 
denotes  either  a  dependence  rdation  or  a  delay.  Unless  otherwise  specified,  the  following 
conventions  are  adopted  for  convenience.  When  an  edge  is  labeled  with  a  capital  letter  D 
(or  D^,  2D,*  •  •),  it  represents  a  time  delay  operator  with  dday  time  D  (or  D',  2D,*  *  •).  The 
SFG  representation  derives  its  power  from  the  fact  that  the  computations  are  assumed  to 
be  delay-free,  i.e.,  they  take  no  time  at  all.  Consequently,  the  burden  of  tracing  the  detailed 
time-space  activities  assodated  edth  pipdining  are  diminated.  Moreover,  any  dday  in  the 
system  has  to  he  expUdtly  introduced  in  the  form  of  so-called  dday  branches.  These  dday 
branches  allow  history-sensitive  systems  to  be  described  in  a  dear  and  unambiguous  way. 

Projnetion  and  Linear  ScbednUnf 

There  are  two  important  condderations  needed  to  be  taken  into  account  in  the  mapping 
from  a  DG  to  an  SFG.  One  is  the  node  oaeiynment,  and  the  other  is  the  scheduling.  The 
node  assignment  invdves  tpedf^ng  the  task  to  be  performed  in  one  duster  of  nodes  in  DG 
be  assigned  to  a  sinf^e  node  in  the  SFG.  The  schednling  involves  spedfying  the  sequence  of 
operations  for  all  the  nodes  in  the  DG. 
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FigUM  3:  Projection  witli  projection  vectot  I\  (b)  ft  lineftr  achedule  f  ftnd  its 
hyperplftoes. 


For  a  SI  DG,  we  caa  om  linear  node  assignment  (projection)  and  linear  scheduling  for 
the  mapping,  both  of  which  will  preserve  the  regular  stmctnre  of  the  DG. 

Projection  A  linear  assignment  (projection)  of  a  DG  is  a  linear  ms^ping  from  the  nodes 
of  the  DG  to  nodes  in  the  SFG,  in  whi^  nodes  akmg  a  straight  line  in  the  DG  ate  mapped 
to  a  single  node  in  the  SFG.  The  projection  direction  is  represented  by  the  projection  vector 
«r.  Mathematically,  a  projectkm  in  a  directkm  / is  reprmented  by^an  n  x  (n  1)  projection 
matrix  P,  which  is  orthofonal  to  the  projection  vector  /,  i.e.,  P^d  s  The  P  matrix  maps 
a  n  dimenrional  node  index  vectm  t  to  an  n  -  1  dimensional  vector  ?  s  P^  (see  Figure 
3(a)). 

Liaenr  Sehndnling  U  a  schedmk,  the  schedekd  exscntion  time  of  a  node  is  represented 
by  a  time  index  (i.e.  an  integv).  The  sdiedale  is  a  linear  schedule  if  a  set  parallel 
equi-temporal  hyperplaaes,  spedlied  1^  the  awmal  vector  f,  are  mapped  to  a  set  of  linearly 
increased  time  indices,  then  the  time  index  of  the  nodes  can  be  mathematically  represented 
by  J*7  (see  Fignre  8(b)). 

PermiaMble  linear  Schetinks 

Given  a  DG  and  a  projection  Erection  i,  we  note  that  not  all  hyper^aaes  are  quaUlied 
to  define  a  valid  schedule  for  the  DG.  Some  of  them  violate  the  pte^enoe  relatimi  of 
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computation  specified  by  the  dependence  arcs.  The  allowable  directions  of  the  hyperplanes 
actually  define  the  class  of  permissible  linear  schedules.  In  order  for  the  given  hyperplanes 
to  represent  a  permissible  linear  schedule,  it  is  necessary  and  sufficient  that  the  normal 
vector  S  satisfies  the  following  two  conditions: 

(1)  for  any  dependence  arc  e.  (2) 

(2)  >  0.  (3) 

Both  the  conditions  Eq.  2  and  Eq.  3  can  be  checked  by  inspection.  In  short,  the 
schedule  is  permissible  if  and  on/y  if  (1)  all  the  dependency  ares  flow  in  the  same  direction 
across  the  hyperplanes;  and  (i)  the  hyperplanes  are  not  parallel  with  prx^eetion  vector  d. 
The  first  condition  means  that  a  cansality  should  be  enforced  in  a  permissible  schedule. 
Namely,  if  node  p  depends  on  node  q,  then  the  time  step  assigned  for  p  cannot  be  less  than 
the  time  step  assigned  for  -q.  The  second  condition  implies  that  nodes  on  an  equitemporal 
h3i>erplane  should  not  be  projected  to  the  same  PE.  The  permissible  hyperplane  directions 
defined  by  the  first  condition  is  the  same  as  the  notion  of  the  time  cone  in  [7]  and  [3]. 

Example:  SFG  for  Convolution 

An  SFG  for  convolntion,  by  projecting  the  DG  onto  the  s  [1,  1]  direction  and  with 
scheduling  vector  s  s  [0,  1],  is  shown  in  Figure  4.  Note  that  the  existence  of  the  delay-free 
edges  means  that  the  data  will  be  propagated  in  **zero  time”.  The  computation  in  each 
node  is  also  assumed  to  be  done  in  “zero  time”. 

2  Applications  to  Image  Feature  Extraction 

In  this  section,  we  demonstrate  this  top-down  design  methoddogy  by  systematically  map¬ 
ping  the  applicational  algorithms  onto  appropriate  VLSI  arrays.  The  applications  we  are 
interested  is  the  image  and  video  signal  processing.  More  specifically,  the  following  algo¬ 
rithms  are  treated  in  this  section. 

•  Edge  detection  via  2-D/l-D  convolution. 

•  Video  enhancement  via  median/rank  mder  filtering. 

2.1  Edgn  D«t«ction  for  Fsatiire  Extraction 

Most  of  the  useful  inlMmation  in  an  image  is  omtained  in  those  regions  where  a  change 
of  gray  levds  or  colon  ocean,  l.e.,  at  the  sdgss.  The  informatkm  contists  of  the  size 
of  the  transition  (edge  magnitude)  and  the  dirsetion  in  which  the  intensity  changes  most 
rapidly  (edge  diiectioa).  These  quantities  can  be  computed  from  the  partial  derivatives  of 
image  fhnctkm  t{*,y)-  The  information  obtained  from  applying  the  derivative  operators 
allows  sagmsntation  ed  an  image,  whi^  is  an  important  step  toward  object  classification 
and  identification.  The  extracted  edge  Information  can  be  used  to  determine  the  contour 
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Fifora  4:  As  SFG  for  convdution. 


of  objects,  and  under  certain  conditions,  the  topological  features  of  3-D  objects  can  be 
determined.  Edge  information  can  also  be  used  to  evaluate  threshold  values  to  isolate 
specific  image  regions. 

2.1.1  Edge  DetectioB  by  monns  of  2>D  Couvolutioii 

Two-dimensional  convolution  it  the  most  oMnmon  way  for  image  edge  detecticm.  Assume 
that  an  image  g  is  to  be  edge  detected,  the  2-D  convolution  involves  convolving  a  small 
pattern  (mask)  f  with  the  larger  image  g.  This  it  done  by  moving  the  window  pattern  f 
over  the  image,  as  shoem  in  Figure  5.  At  each  point  the  conndution  is  computed: 

e(m,n)»^^/(i,j)f(m-i,n-j)  (4) 

•  i 

Various  local  operators  have  been  widely  used,  such  as  Eoberts  operators,  Lapladan  oper¬ 
ators,  Pieeritt  operatocs,  and  the  Srdiel  operators  (see  Figure  6).  The  Lapladan  operators 
detect  the  edgm  as  the  local  maxima  of  tlM  image  gradients.  Thmefere,  sero-crosdng  of  the 
seomd  derivatives  gives  the  edge  points.  Fbrthennofe,  the  Lapladan  opmator  can  pick  up 
edges  from  aU  poesilde  directions  (isotrtqdc)  by  a  simple  convolution  with  the  image  and 
potentially  prodaoa  very  thin  edges. 
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f1g«M  6:  Vwioat  wiadowa  oMd  ia  adf*  detection:  (»)  Pnwitt  operatoie;  (b)  Sobdi 
operatoce;  (e)  Lepinden  operator;  (d)  e^qMaded  Leplndea  operaton. 
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2.1.2  Array  Design  tar  2-D  Convolution 

For  2-D  convolution  we  define  x  ktX  k%  matrix  as  a  window.  Since  the  size  of  an  image 
may  typically  vary  firom  256  x  256  up  to  8K  x  8K  pixels,  we  immediately  see  the  necessity 
of  massive  parallel  procesring.  For  real  time  applications,  where  the  image  is  updated  30 
to  60  times  per  second,  the  speed  requirements  are  even  more  critical.  In  the  following,  an 
SFG  design  for  the  2-0  convcdutim  is  described. 

DG  Design  Without  loss  of  generality,  auume  that  the  window  size  is  3  x  3  and  the 
image  rize  N  x  N.  Then  £q.  4  can  be  rewritten  as: 

3  3 

e(m,  n)  =  53  -*»«->)  (5) 

•aOiarf) 

Since  there  are  four  indices,  t,y,m,n,  in  this  equation,  the  DG  for  this  algorithm  is  4-D 
(four  dimensional)  aad'the  SFGs  obtained  via  projection  are  3-D.  Because  of  the  difficulty 
in  displajring  the  4-D  DG,  we  first  decompose  the  double  summation  term  in  Eq.  5  into 
three  terms 


3  3 

c(m,  n)  =  2  «  - ;)  +  /(i.iMw  - 1, «  -  j) 

jmO  jmO 

3 

-  (6) 

y«o 

each  sunounation  term  in  Eq.  6  may  be  described  by  the  3-D  DG  as  shown  in  Figure  7(a). 
The  *3-D  DG  represents  the  image  convolving  with  one  row  of  the  window  pattern  (1  x  3). 
Note  that  each  2-D  (3  x  N)  layer  of  the  3-D  DG  is  basically  a  DG  for  1-D  convidntion.  The 
4-D  DG  may  be  oonstmctcd  by  summing  up  the  outputs  of  three  such  similar  3-D  DGs. 

SFG  Design  Let  us  first  conrider  the  design  of  a  3-D  SFG  with  (approximate)  size 
3x3x  N.  This  3-D  SFG  may  be  obtained  by  first  projecting  each  of  the  three  3-D  DGs 
to  one  2-D  SFG  (of  size  3  x  iV)  (see  figure  7(b))  and  then  combining  these  three  2-D 
SFGs  by  summing  up  their  outputs  (see  Figure  7(c)).  U  2-D  SFGs  are  preferred,  then 
multiprojection  can  be  adc^ted  to  project  the  3-D  SFG  to  2-D  SFGs.  Figure  7(d)  shows  a 
2-D  SFG  with  riM  3  x  N.  IHlIetmit  projection  directkms  can  also  be  applied  if  desired.  For 
example,  it  is  apparent  that  a  3  x  3  SFG  can  also  be  obtained  by  changing  the  direction  of 
multi-projection. 

2.1.3  Usn  1*D  Amya  to  Poribraa  1-D  Edge  Dotoetion 

la  general  the  classic  gradieat  or  L^lndan  operators  perform  poorly  im  noisy  images. 
I  To  improve  the  performance,  one  solutioa  is  to  do  averaging  belMe  the  ^>plication  of 
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the  operators.  This  results  in  an  expanded  Laplacian  operator  with  9x9  mask  size  (see 
Figure  6(d)),  which  can  be  used  in  nmsy  averaging  and  edge  detecting.  Marr  and  Hildreth 
also  suggest  a  family  of  edge  operators  based  on  the  zero-crossing  of  a  generalized  Laplacian 
[24],  which  are  also  isotropic  second  derivative  zero-crossing  operators.  Figure  8(a)  shows 
an  example  of  an  11  x  11  generalized  Laplacian  operator.  When  a  larger  mask  operator 
is  adopted,  the  performance  is  in  genaal  improved  but  at  the  expense  ot  higher  hardware 
cost.  To  overcome  this  hardware  problem,  an  alternative  is  proposed  bdow. 

Note  that  most  of  the  large  mask  operators  share  a  low  rank  property.  For  example, 
the  expanded  9x9  Laplacian  operator  shown  in  Figure  6(d)  has  only  rank  two.  The 
generalized  11  x  11  L^ladan  operator  shown  in  Figure  8(a)  has  numeric  rank  two,  based 
on  the  distribution  of  thar  nngular  values  as  shown  in  Figure  8(b).  (Note  that  the  first  two 
singular  values  are  significantly  larger  than  the  rest.) 

Let  p  denote  the  numeric  rank  of  a  h  x  h  mask  operator  W,  e.g.,  h  =  9  or  11  and  p  =  2 
in  the  above  examples.  Then  W  can  be  approximated  by  a  linear  combination  of  p  outer 
products,  (see  Eq.  2.17)  ' 


W  »  OiUivf  =  ^  ttivf  (7) 

•al  tel 

where  n,-  and  v,  are  the  singular  vectors  of  W,  and  Ui  and  Vj  are  the  singular  vectors  scaled 
by  the  square  root  of  the  singular  value  ffi.  For  example,  the  scaled  singular  vectors  of  the 
expanded  9x9  Lapladan  operator  are 


fii  *  (1  1  1  -4  -4  -4 

vi  s  [0  0  0  -1  ~1  -1 

fia  =  (0  0  0  -1  -1  -1 

va  s  [1  1  1  0  0  0 


1  1  1] 
0  0  0] 
0  0  0] 
I  1  1] 


Eq.  7  means  that  the  2-D  edge  detectl(»  can  be  implemented  by  a  combination  of  cascaded 
l-D  cdumn  convolutioiis  and  1-D  row  convolutions.  More  daboratdy,  the  image  is  first 
processed  by  a  row  oonvolutioa  then  fbOowed  by  a  column  convolution.  Mathematically,  let 
W*  *  g  denote  the  2-D  coavdution  erf  the  mask  oporator  W  and  the  image  g,  thoi  based 
on  Eq.  7 


W  •  eg  «  fti  *e  (^1  e,  g)  +  Va  ("^a  *r  g) 

where  Se  and  *r  denote  1*D  column  convolutiatt  and  1-D  row  omvalntlon  respectivdy. 

The  array  procussor  design  for  the  cascaded  tow/column  convolutions  may  be  easily 
carried  out  hy  using  the  canonical  m^^ng  naethodology.  Since  p  «  k  in  general,  this 
i^iproach  can  yield  a  sigttiftcaat  hardware  saving  compared  with  the  2-D  convolution  design. 
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Figure  0:  The  eugular  vmlue  deeompooitioa  of  genttalued  Lepladu  opaetor;  (a) 
the  original  operator;  (b)  the  angular  values  distribution;  (c)  the  reconstructed 
operator  using  the  first  too  ranks  only. 


2.2  Median/Rank-Order  Filtering  for  Image  Enhancement 
2.2.1  Median  Filter  for  Video  Signal  Proeaming 

Median  filters  are  a  special  class  of  nonlinear  filters  useful  in  the  removal  of  impulse  noise 
from  signals  [27].  The  idea  ai  the  median  filter  is  very  simple.  Take  a  sampled  signal  of 
length  I  and  slide  it  across  a  udndow  of  length  2N  +  1,  the  filter  output  at  each  window 
pontion  is  given  the  same  position  as  the  center  sample  of  the  window  and  is  set  equal  to 
the  median  value  of  the  2JV’  + 1  samples  in  the  window.  Stait-np  and  end  effects  ate  taken 
care  of  by  appending  samides  emutant  vnlne  to  the  be^nning  and  the  end  of  the  data 
sequence.  As  an  example  oimsider  the  sequence 

3  4  7  1  2 

The  median  is  found  Iqr  first  sorting  this  sequence  and  then  choosing  the  center  value  of 
the  Slated  sequence.  Hence  the  original  center  pixel  value  of  the  piocassiag  window  (here 
of  length  five),  *7”,  is  teplaioed  by  the  median  of  the  sequence,  An  attractive  property 
of  median  filters  for  int^  processing  is  that  it  removui  sparUe  noise,  while  preserving 
edges.  This  means  that  while  the  traditional  linear  ffitaring  is  unable  to  preserve  the  scene 
changes,  the  mediu  filtering  has  no  such  proUems.  Coasiifor  the  examrie  shown  in  Figure 
9(a),  wlwre  the  scene  change  may  be  perceived  as  an  edge,  a  madiaa  filter  of  window  length 
3  Is^  to  a  result  shown  In  figure  9(b).  This  property  may  be  exploited  in  frame  to  frame 
basis  video  signal  processing,  where  scene  dtangee  neM  to  be  preserved. 
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FiciiM  •:  («)  Vidao  ngaal  with  time  level  ecene  change  on  a  frame  to  frame  baeiB. 
(b)  Median  filteied  video  eignal  (with  filter  window  length  3). 


2.2.2  Noiae  Removal  via  Median/Raak  Order  FUterinf 

One  approach  to  the  madiaa  fUtering  ia  to  om  aa  SFG  eorting  arrays  and  to  sort  out  the 
median  value  of  a  data  vdndow  (4],  [25).  The  window  then  slides  one  pixd  further  to  let 
the  sorter  generate  the  next  median  value  and  so  <hi.  The  bubble-sorter  design  [15]  can  be 
adapted  to  realiM  each  moiiag  vnn^iw  characteristics  for  the  median  filtering.  This  kind 
of  approach  can  be  claisified  as  being  tsindow-oriented,  in  which  the  pixels  in  every  window 
are  separately  sorted.  Most  window-oriented  designs  actually  use  2-D  sorting  arrays.  It 
is  wasteful  and  is  not  appealing  to  large  windows,  because  of  the  large  array  sise  and  low 
utilisation  rate. 


Rank  Ordor  FUtoring  A  mote  efBdent  paw/  erienfed  approach  is  rank  order  filtering, 
where  the  ranks  tit  the  intensities  at  the  pixels  are  detenniuod  in  descending  order.  The 
pixel  that  has  the  required  rank  Is  extracted  as  output,  while  the  ranks  of  all  but  one  (rf  the 
pixels  in  the  irindow  are  usalU  fsr  the  rank-ordering  of  the  next  window.* 

Omrider  a  sequence  of  piade  and  a  l*D  utedow  IFof  length  h.  As  the  windkiw  slides 
into  the  next  one,  aU  the  pixels  enospt  the  departing  one  appear  again  in  the  next  window. 
Therefmu,  if  the  raakiag  in  the  psuesn.  wind^  is  evaluated  and  stored,  the  tanking  in  the 
next  window  can  be  determiieil  hy  a  simple  mediicatien  of  the  present  rankiag  rather  than 

^TMseppweA  to  sppMcabiefctssttBrtlagaeSeBly  the  wegaamlee  bet  alee  data  Meayepecified  taak. 
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Figure  10:  A  window  of  length  S  fiat  rnnk  ordering  end  ite  next  window. 


n  reevnlantion  £rom  scrntch.  With  reference  to  Figure  10,  suppose  that  the  window  length 
is  h  =:  5  and  the  present  window  considered  is  Wr  s  [xs  X4  x$  xe  X7].  The  next 
window  Wt  »  [X4  xs  xs  xr  xg]  is  obtained  from  W7  by  ddeting  the  pixel  xs  and  inserting 
the  pixel  x$.  Suppose  that  the  ranJu  of  i»xels  {xg,  xg,  xg,  xr}  are  previously  evaluated 
in  Wr,  say,  as  {r,7,  »  *  4,  5,  6,  7}.  Therefore,  their  new  ranks  {fig}  in  the  window  Wg 
can  be  determined  by  comparing  the  pixds  {xj,  t  ss  4,  5,  6,  7}  with  the  departing  pixd 
X3  and  the  new  arrival  xg,  and  accordingly  modifying  {fir}  into  {r^g}.  This  is  called  the 
PDI  (pixel  deletion/insertion)  process,  frt  the  same  process,  the  rank  of  pixel  xg,  rgg,  can 
also  be  obtained.  Each  window  requires  0(l()  oanparismu  fw  the  pixel-oriented  approach, 
compared  with  O(k^)  comparisons  f<x  the  window-oriented  approach. 

2.2.3  Array  Design  of  a  Rank  Order  Filter 

Our  discussion  will  be  based  on  one  example  showing  that  the  ranks  in  one  window,  e.g., 
{rjr},  lead  to  the  ranks  in  the  next  window  {ra}.  Then  by  induction,  the  overall  procedure 
should  follow.  Suppose  that  after  the  7-th  recursion,  the  ranks  {r37,  r47,  . . . ,  r77}  are 
available^  and  the  data  are  arranged  in  a  revmed  tnder 

XT  Xg  Xg  X4  Xg 

Now  the  new  input  data  xg,  xg,  ...  are  available  from  the  right  gide.  Then  the  DG  for  the 
PDI  procsdure  is  shown  in  flgare  U(a),  and  the  ootrospondiag  SFG  obtained  by  projecting 
the  DG  in  the  vertical  direction  is  shown  In  Figure  11(b).  As  shown  in  the  DG,  the  PDI 
procedure  consists  of  two  processing  phases  (phases  A  and  B).  Fbr  the  fidlowing  illustration 
at  the  proosssiag  in  the  SFG,  we  note  that,  fat  the  8>th  reoirska,  xg  is  the  deletion  pixel 
and  Xg  ig  the  tnscrtion  piteL 

*Start-sp  caa  b«  tabn  can  of  fy  appsadiag  coaatast  T~air‘~~  (04.,  O's)  to  tko  hogiaaiag  of  tk«  aeqaeaca. 
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•  •  • 

•  •  • 

•  •  • 


Projection 


(a) 


FigOM  11:  (•)  DG  Cor  Uie  pixd  ddetion/iniation  proeedaie.  (b)  The  comepond- 
inf  SFG  obtaioed  by  projecting  DG  in  the  vertical  direction. 


Pbnl  Dnkftioa  Raitk  Updating  In  phaaa  A  of  the  8-th  teconion,  the  data  za  is  prop¬ 
agated  to  the  left,  meeting  all  the  other  data  {x^  x$  xr}  in  their  respective  PEs.  The 
PEs  perform  the  fdlowing  fdnction: 

For  t  s  4,  5,  6,  7 

npdntn  ra 

r'n  *  if  *t>*3 

r|r  s  tir  otherwise 

We  note  that  {zj,  r|7}  shonld  be  moved  to  the  right  neighbor  PE  after  each  update  to  be 
ready  fmr  the  phase  B  protesting. 

Kxel  Insertion  Rank  Updating  In  the  phase  R  of  the  8-th  reoution,  the  data  zg  is 
propagated  to  kft  meeting  all  the  other  data  {sg  Zs  s«  zr}  in  the  array  in  their  respective 
PEs.  The  PEs  perform  the  following  fiinctloa: 
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For 


t 


4,  5,  6,  7 


update  Tit 

ri$  =  K7  +  1  *•  <  *• 

nr  =  otherwise 

Rank  Evaluation  of  New  Pixel  Note  that  zs  is  the  new  arriving  pixel,  and  its  rank 
most  be  evaluated.  This  evaluation  process  can  be  accomplished  while  the  pixel  insertion 
process  is  taking  place.  The  procedure  is  described  as  follows: 


Set 

toe 

s 

1  initially 

Fbr 

i 

= 

4,  5,  6,  7 

update 

<Si 

tti 

s 

ts,t— 1  tf  Zj  <  Zs 

toi 

s 

+ 1  otherwise 

propagate 

<as 

to  left 

Output 

•‘as 

s 

tsr 

Here,  an  auxiliary  variable  tsi  i*  introduced  for  the  purpose  of  counting  the  number  of  pixels 
greater  than  or  equal  to  zs*  After  all  the  comparisons  are  performed,  the  rank  for  zs  can 
be  determined,  r$a  s  tsr*  We  note  that  it  is  easy  to  combine  the  rank  evaluation  process 
with  the  pixd  insertion  process. 

Rank  Extraction  of  tho  Currant  Window  The  rank  extraction  problem  here  is  to 
determine  the  integer  t*,  such  that  r,-««  equals  the  desired  rank  and  extract  Zj*  from  the 
array.  For  convemeace  of  pipeline  array  design,  it  is  pnq>osed  that  the  data  z,*,  once 
identified,  should  be  propagated  leftward  and  eventually  output  from  the  leftmost  boundary 
PE.  In  our  deoifn,  the  PDI,  rank  evaluation,  and  rank  eztraetion  proceaaea  are  all  embedded 
into  one  linear  array. 

2.2.4  2*D  Median  Filtering 

Image  enhancement  for  video  signal  procesring  applications  can  malm  good  use  of  1-D 
median  filtering  perfwmed  on  a  frame  to  frame  basis.  However,  for  most  other  image 
processiag  applications,  we  still  require  filt«iag  to  take  place  in  two  dimensi<ms.  The  k^ 
properties  of  the  2-D  median  filter  are  mostly  preserved  by  uring  two  separated  1-D  median 
filters,  one  filter  processes  pinds  along  the  rows  and  then  the  resulting  image  is  processed 
by  the  other  filter  alcmg  the  columns.  Thus  2-D  median  filtering  can  virtually  be  performed 
by  using  two  1-D  SFG  arrays  [26]  [28]. 
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3  Array  Design  for  Artificial  Neural  Network 

Neuroscientists  have  revealed  that  the  massive  parallel  processing  power  in  the  human  brain 
lies  in  the  global  and  dense  interconnections  among  a  large  number  of  identical  logic  elements 
or  neurons.  These  neurons  are  connected  to  each  other  with  variable  strengths  by  a  network 
of  synapses  [33].  The  original  discrete-state  Hopfield  model  [29],  and  the  continuous-state 
Hopfield-Ta^  model  (including  the  proposed  analog  neural  circuits)  [30], [31]  have  recently 
become  popular  in  the  realization  of  artificial  neural  networks  (ANNs).  They  can  be  pro¬ 
grammed  to  perform  computational  networks  for  associative  retrieval  or  for  optimization 
problems.  Several  optical  computing  approaches,  exploiting  the  global  interconnectivity  of 
optical  signal  flow,  have  been  proposed  [34],  [35],  [36]. 

Both  the  analog  neural  circuits  and  the  optical  neural  networks  suffer  from  the  dis¬ 
advantages  of  low  precision,  difficulty  of  modifying  the  synaptic  strengths,  convergence  to 
local  optima  and  global  interconnectivity.  In  order  to  overcome  the  disadvantages  mentioned 
above,  a  locally  interconnected  SFG  array  for  an  ANN  is  proposed  [11]. 

3.1  Hopfield  and  Hopfield-T^nk  Models 

Original  Hopfield  Model  The  original  Hopfield  model  used  two-state  threshold  neurons. 
(The  states  are  usually  taken  to  be  0  and  1).  In  this  discrete  model,  each  neuron  i  receives 
input  currents  of  TijVj  firom  neuron  j,  and  a  luas  current  input  /<  (see  Figure  12(a))  [29], 
[33].  The  discrete-time  transition  of  neuron  t  can  thus  be  formulated  as: 

Uiik)  =  'tTiiViik)  +  li 

V<(ib-H)  =  stepiUm  (8) 

where  step{x]  is  a  unit  step  function,  which  is  1  for  z  >  0  and  0  for  z  <  0.  N  is  the 
number  neurons  aad  are  dements  of  an  interconnection  matrix  representing,  the 
synaptic  strengths  of  jffyi  (with  7m  =  0).  The  inputs  (/,  are  thresholded  by 

the  amplifier  (neuron),  aad  the  output  Vi  «•*"  then  be  fed  back  to  the  input  of  any  other 
amplifier  to  modify  their  states.  The  state  space  transitions  will  gradually  converge  to  a  set 
of  stable  fixed  points. 

Hopfield  and  Tank  Model  In  order  to  imitate  the  continuous  input-output  rdationship 
of  r^  neunms,  and  also  to  simulate  the  integrative  time  dday  due  to  the  capadtance  of  real 
neuron,  the  continuous-state  modd  proposed  by  Hopfidd  aad  Tank  can  be  approximated 
by  the  following  dynamic  equatimu  [30],  [31],  [33]: 


K<*)-lf.(*-l) 

«  T,TiiVi{k)  +  Ji 

(9) 

v;(*-n) 

»  swm 

(10) 
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FigVM  12:  (•)  A  wnplified  ■chenwtic  diagram  of  the  Hopfteld  nx>del.  In  the 
diacrete-atate  model,  the  ampUiieia  act  like  a  hard  limiter,  while  in  the  continuoua- 
atate  model,  the  ampliiieia  follow  the  input-output  relationahip  pi[Att]  with  dynamic 
behavior,  (b)  The  typical  input-output  relationahip,  the  A  value  detominea  the  gain 
of  the  threaholding  function. 


where  g[x]  is  a  nonlinear  function,  e.g., 

«(*)  =  (1/2)(1  +  tenh(x/»o)l  (11) 

which  approaches  a  unit  step  function  as  «o  tends  to  zero  (see  Figure  12(b)).  The  right  hand 
side  of  Eq.  9  can  be  considered  as  the  new  excitation  source,  which  effects  “modification” 
of  the  states  as  shown  in  the  left  hand  side. 

For  both  models,  an  energy  ffinction  is  defined  as  [29],  [30] 

E  »  _  ^i,Vi  (12) 

ml  Jmt  ml 

Hopfleld  has  shown  that,  if  Tif  s  Tji,  then  neurons  in  the  continuous-state  model  always 
change  their  states  in  such  a  manner  that  the  energy  function  is  reduced  [30]: 

Matrix  Formulation-  The  Hopfidd  modd  can  be  formulated  as  a  consecutive  matrix- 
vector  multiplication  problem  with  some  preepedfied  thresholding  operations  [34].  For 
example,  a  matrix-form  expression  of  Eq.  9  and  Eq.  10  can  be  written  as 


u(*)  =  Tv(*)  +  i.»-u(ife-l) 
v(*.|.l)  =  G[u(fc)] 


(13) 


where  G[x]  function  specifies  the  nonlinear  thresholding  of  each  element  of  the  vector  x, 
and  the  vectors  and  matrices  used  are  ^ven  as: 

a  =  [Ifi,  Uj,  •••,  tvF 
V  *  [Vi,  Vi,  .  Vwf 
»  *  (ii.  fit  /wF 


Tu 

Tn 

Tu 

Tu 

•••  Tiff 
Tin 

T  = 

IL 

L 

•  • 

•  • 

•  • 

•••  Tsn  . 

(14) 


3.2  SFG  Doaign  via  Cascade  DG 

Caacada  DG  Dosign  The  cmisecutive  matrix-v«ct<»  multiplication  array  architecture 
design  can  be  derived  frmn  a  cascaded  DG  with  nonlinear  assig^ent.  The  DG  of  Eq.  13  is 
shown  in  ngure  13.  Using  a  nonlinear  assignment,  a  locally  interconnected  SFG  array  with 
bi(Urecti<mal  communication  links  can  be  obtained.  This  SFG  architecture  requires  some 
smart  sudtdms  to  change  the  operadmu  of  eadi  PE  at  different  time  slots.  However,  some 
Ijj’s  need  to  be  repetitivdy  stmed  in  multiple  PEs,  and  making  the  design  unsuitable  for 
adaptive  modificatitm  ci  Tij. 


20 


356 


Flgur*  IS:  DG  for  eooMcutive  iiuitrix>vector  mulUpIieotion  fonmilfttioo  of  Hopfidd 
modd. 


Modified  Ceecede  DG  Design  Rxemiaittg  the  DG  design  shown  in  Fignre  13  more 
doedy,  we  note  thnt  many  nndesimble  design  aspects  are  due  to  the  fact  that  the  input 
directum  nenitm  states  l^(h)  is  arthofonal  to  the  output  direction  of  the  threshoided 
neuron  states  Vi(k  + 1).  It  is  possible  to  rearrange  the  data  ordering  of  the  7jj  dements,  so 
that  the  input  direction  l^(h)  becomes  parafld  to  the  output  direction  of  Vi^k  +  !)■  Such  a 
modified  DG  is  depicted  in  Fignre  14.  b  this  DG, fi>r  t  s  1,  2,  N,  the  t-th  <^umn  of 
the  Tij  data  array  is  drcnlaily  sUfted>up  by  t—  1  podtkms.  This  DG  is  not  totally  localised 
due  to  the  presence  of  the  global  sidral  communication  arcs.  However,  the  input  direction 
(from  the  t<v)  and  the  output  direction  (from  the  botUan)  are  paralld.  The  advantage 
is  that  when  many  sndi  DGs  are  cascaded  top-down,  the  inputs  and  outputs  data  can  be 
matched  pmliKtly. 

Ring  Array  fi>r  ANN  For  the  top-down  cascaded  DG,  the  projection  can  be  tal»n  along 
the  vertical  direction,  which  will  result  in  a  ring  SFG  array  as  shown  in  Fignre  15.’  In  the 
ANN  implementation  eadi  SFG  node,  say  the  i-th  node,  is  treated  as  a  neuron,  and  the 
synaptic  strengths  (Ta,  Ta,  . ..fTai)  are  stored  in  it.  At  the  h-th  iteration,  the  operation 
at  the  node  is  as  foUows: 

*Tha  Mas  Mcyiactwe  was  ptsvioedy  pwposad  by  Porter  [U],  fat  oaasocativs  Botiix-aclar  waltipli- 

catieB  ia  solvias  ihcwti  state  apace  eqaeltem. 
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«,»,(•)  »,v®* 


•  •  • 

•  •  • 

•  •  • 


Figan  14:  Modified  DG  for  eonaecntive  nuttrix-vector  multipUcotion  formulation 
of  Hopfidd  ODodd. 


1.  Each  of  the  nearon  oatpata  (Vi,  V3,  ...,Vfi)  is  cycling  through  the  ring  array,  and 
will  pass  through  the  t-th  node  through  broadcasting. 

2.  When  Vj  passes  through  the  t-th  node,  it  is  multiplied  with  Tij,  and  the  result  is 
added  to  the  sum  <d  Vi(k  -  1)  and  /{ (according  to  the  Eq.  9). 

3.  After  Vj  passes  through  al  the  nodes,  the  computntion  for  Ui(k)  is  crmipieted,  and  it 
is  ready  fnr  the  thresholding  (iteration. 

4.  After  the  thresholding  operations,  the  PE  sends  the  thresholded  neuron  output  Vi{k  •(- 
1)  to  the  left-side  seighbOT  PE. 

The  above  procedures  is  repeated  until  a  ctmvcrgence  is  reached.  Ftw  implementing 
a  large  number  of  neurons,  the  problem  of  the  long  wrap-around  Une  can  be  sidved  by  a 
special  2-D  arrangement  s^enm  [11). 

Advntrtafaotts  Proparliae  of  SPG  ANN  The  advantages  of  this  array  architecture  for 
ANN  are  summarised  as  fioOows: 

e  Only  N  synaptic  strengths  of  Tj,  are  stoied  in  eadi  node.  This  results  in  easier 
mo^cation  ^  the  syn^tic  strengths,  making  the  "leanking”  capaNlity  poedble. 
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Figur*  15:  Ring  SFG  array  for  coaaecutive  maltix»vector  multipUcation  formula- 
tioa  of  HopSdd  model. 


e  Using  this  proposed  SFG  architectme,  the  gain  parameters  can  be  easily  updated 
dnring  the  iterations.  (It  is  observed  that  if  the  g^  contnrf  parameter  of  the  sig¬ 
moid  inpnt-ontpnt  rdatkm  in  the  nearon  can  be  dynamically  changed,  then  a  faster 
convergence  and  better  performance  can  be  obtained  [31].) 

s  Compared  to  the  analog  RC  nenral  drcnit  and  the  other  i^tical  neural  networks,  the 
^gital  imjdemeatatkm  can  acUeve  higher  precision  in  computation. 

4.3  Applicntioiis  of  ANN  in  Image  ProceMing  and  Analynin 

Solving  Image  Bestomtion  Problems  using  nn  ANN  ArtiSdal  neural  netimks  have 
been  successfully  ap^ied  to  low  levd  viskm  processing  [37].  Here,  an  image  restoration 
example  is  given  to  iUnstrate  how  to  map  apj^catkmal  p^lenu  onto  ANNs.  Consider  an 
observed  degraded  image  vector  g,  wUch  can  be  mathematically  expressed  as 

g  w  Hf-fa  (15) 

where  R  is  a  known  blurring  matrix.  The  statistical  properties  ctf  the  noise  vector  n  are  also 
assumed  known.  Image  restoration  is  the  scheme  whereby  an  image  vector  f  is  restored  from 
the  linear  blurring  degradation  mechanism  and  the  additive  noise.  The  moot  straightforward 


method  is  to  solve  the  least  squares  problem  to  find  an  estimate  f  which  minimizes  the  total 
estimation  error. 


min  (g-Hff(g-Hf)  (16) 

In  many  cases,  however  a  priori  information  about  the  image  properties  (e.g.,  smooth¬ 
ness,  intensity  distribution)  is  known.  In  order  that  the  estimated  solution  also  reflects  this 
information,  a  modified  least  squares  formulation  should  be  adopted: 

min  (g  -  H?)^(g  -  Hf)  -I-  ^CWO^’CWf)  (17) 

where  the  W  matrix  represents  the  intensity  weighting  for  the  overall  smoothness  measure 
of  the  image,  and  7  is  a  proper  r^nlarisation  parameter. 

To  formulate  the  regularized  image  restoration  problem  in  terms  of  ANN,  the  key  step 
is  to  derive  an  energy  function  so  that  the  lowest  energy  state  (the  most  stable  state  of 
the  network)  would  cmrespond  to  the  best  restored  image.  Once  the  energy  function  is 
determined,  the  synaptic  strengths  and  input  can  be  immediately  derived.  Let  each  pixel 
of  image  /<  correspond  to  the  neuron  state  K-,  then  the  derived  energy  function  is  equal 
to  the  expression  given  in  E^.  17.  By  comparing  Eq.  12  and  Eq.  17,  the  corresponding  T 
matrix  and  i  vector  are  found  to  be 


T  *  -2(H^H  +  iW^'W) 

i  =  2H^g  (18) 

Once  T  and  i  are  determined,  the  ANN  can  be  programmed  accordingly  to  solve  the  ima^ 
restoration  problem. 

Using  ANN  for  Aesocintivo  Pattern  Recogniser  The  discrete-state  Hopfield  model 
can  be  omsidersd  as  an  associative  memory;  therefore,  it  m^  be  adopted  for  image  pattern 
recognition  ^tfdications  [39],  [Psalt85].  Briefly,  the  discrete-time  transition  of  neuron  t  is 
formulated  as  (with  li  =0): 

m)  -  ETijVj(k) 

Vi(k  +  1)  *  steplUi(k)J  (19) 

where  ster{z]  is  a  unit  step  fonctimi,  whidi  is  1  fw  z  >  0  and  0  for  z  <  0. 

For  the  associative  retrieval  purpose,  let  the  reference  patterns  be  represented  by  v”*  s 
[V7”,  Vp,  ...,  Vff],  where  m  *  1,  2,  ...,  fif,  then  the  synaptic  strengths  {Ilij},  where 
1  S  i  ^  N,  are  d^ved  as  follows: 

(M) 
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where  the  states  {V^”*}  have  binary  valnes  0  or  1. 

For  pattern  recognition,  an  unknown  test  pattern  is  initially  input  to  the  SFG  ANN 
of  Figure  15,  The  network  iterates  fdlowing  the  transition  rule  given  in  Eq.  19.  When 
the  state  of  the  neural  network  converges  to  a  final  state  v*,  then  v*  is  output  from  the 
network.  In  a  pattern  recognizer,  this  output  v*  must  be  compared  with  the  M  reference 
patterns  {v*",  m  =  1,  2,  . . .,  iV}  to  determine  if  it  exactly  matches  any  of  the  reference 
patterns.  U  it  does  not  match  then  a  *no  match”  is  declared.  U  it  does,  the  output  will  be 
the  matched  reference  pattern. 

4  Kalman  Filtering  for  Least  Squares  Estimation 

Kalman  filtering  has  found  frequent  applications  to  many  time  varying  (or  time  invariant) 
signal  processing  problems,  such  as  those  encountered  in  communications  and  contrtd,  radar 
and  sonar  processing  and  so  on.  A  discrete  time-varying  recursive  dynamic  system  can  be 
represented  as: 


x(ik-l-l)  =  F(fc)x(k)-»-w(fc-t-l) 

y(*)  =  Cik)x{k)  +  v{k)  (21) 

where  F(ib)  and  C(ib)  are  coeflldent  matrices  with  dimension  n  x  n  and  m  x  n;  x(k)  and 
w{k  +1)  are  the  ti-dimensional  state  vector  and  system  noise  vector  respectively;  y(k)  and 
v(k)  are  the  m-dimensional  measuremmtt  vector  and  measurement  noise  vector  respectively. 
The  nmse  vectm  have  zero  mean  and  known  covariance  matrices  Rw(Ar  -I- 1)  and  Rv(k) 
respectivdy.  The  noise  w  is  assumed  to  be  nncorrdated  with  v  (i.e.  .F[w(t)v(j)]  =  0,  for 
all  i,i). 

4.1  Least  Squares  Formulation  of  Kalman  Filtering 

The  Kalman  filtering  is  to  compute  the  optimal  prediction  of  x(ik-f  1),  denoted  as  x(ik  -I- 1), 
based  on  known  measuroneats  {y(l)»]r(2),  -  *  -  ,y(k)}  [40].  The  best  prediction  for  the  state 
vector  in  Eq.  21,  based  on  a  linear  mlnimnm  variance  criterion,  can  be  sdved  recursively 
with  computatkiaal  emnplcxity  of  O(ii’).  In  the  following,  we  reformulate  the  Kalman 
filtering  algorithm  into  a  classic  least  squares  problem.  Fbr  more  details,  see  [41],  [42], [43]. 

For  colored  noise  cases,  where  the  covariance  matrix,  R.v(h  +  1)  and  ILv(ib),  are  not 
identity  matriees,  a  whiteaiag  procedure  has  to  be  first  applied.  The  covariance  matrices 
of  the  two  noise  vectors  can  be  expressed  as: 


.  W(»+i)W’'(t+l) 
«;•(*)  .  V(t)V>’(») 


where  W(ft  + 1)  and  V(ib)  are  upper  triangular  matriee*  obtained  from  Cholesky  decompo¬ 
sition  [32].  Applying  premoltiplication  of  the  whitening  operators  W(k  +  1)  and  V(k)  to 
Eq.  21  yields: 


W(ib-H)x(*-H)  =  W(ib+l)F(*)Jt(ik)-^W(*  +  l)w(*-^■l) 

V(ib)y(*)  =  V(fc)C(*)x(*)  +  V(jb)v(*)  (22) 

By  grouping  together  the  state  vectors  up  to  stag^  k  and  forming  a  large  vector  X{k),  22 

can  be  represented  by  the  following  matrix-vector  form  [41] 

U(ifc)  =  A(*)X(*)  +  Y(*)  (23) 

where 


X(*)  =  [x^(l)x*’(2)  ...  x^(k)f 

U(*)  =  [w^(l)  v^(l)  w^(2)  v^(2)  . .  .v^{k  -  1)  w^(ik))^ 

Y(*)  =  [0yr(l)0y^(2)...y^(*-l)0]’’ 


t 

i 


\ 


and 


A(fc) 


■  W(l) 

C(l)  0 

F(l)  W(2) 

C(2) 

F(2)  W(3) 


W(*-l) 

0  C(ib-l) 

F(*-l)  W(*) 


whew  t(k)  =  -W(*  +  1)P(*),  tik)  -  V(*)C(*),  w(*  + 1)  »  W(*  +  l)w(ib  +  1),  y(ifc)  = 
-V(k)y(k)f  and  ^k)  as  -V(fr)v(ib).  In  theabow,  it  is  aason^  that  x(0)  s  0  and  thmfow 
w(l)  *  W(l)x(l). 

The  noiae  vector  U(h)  in  Eq.  23  is  white  with  seio  mean  and  an  identity  covariance 
matrix.  ThereflMe  the  best  estimate,  i(k),  given  {y(l)*‘*y(h  -  1)},  can  now  be  sdved 
as  a  least  squares  estimation  proUem  nstaig  the  QE  decomposition  method.  Applying  an 
orthogonal  tranfermation  matrix  Q,  with  a  dimension  of  [(h  -  l)m  -f  hn]  x  [(h  -  l)m  +  hn] 
at  stage  k,  for  both  sides  of  Eq.  23,  gives: 
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where 


QU(h)  =  QA(ir)X(ib)  +  QY(h) 


(QA(fc)|QY(*)]  = 


Rii 

Ri3 

1  *»; 

R33 

R33  0 

1  K 

0 

R*-i.*-i 

Kfc-r.* 

1  : 

1  bLi 

R(h) 

1  hk 

0 

0 

0 

0 

• 

1  *“1 

0 

0 

0 

• 

0 

1  : 

1  rk-i  . 

(24) 


In  the  above  expressioa  the  enbmatiicet  Rm-  and  R(h)  are  upper  triangular;  {b|,  . . . , 
are  n  dimenaional  vectors;  and  {ri,  r^,  . . ra-i}_are  m  dimensional  residnal  vectors.  Note 
also  that  nnder  the  orthogimal  transformati<m,  QU(h)  remains  white  and  therefore  the  best 
estimated  state  vector  SL{k)  depends  only  on  the  vector  bs: 


xik)  =  -R(*)-‘bfc 


(25) 


Since  11(h)  is  an  upper  triangular  matrix^  Eq.  25  can  be  solved  by  back  substitution. 


4.2  Recunive  Leant  Squaren  Eatimation  of  Kalman  Filter 

At  the  next  recursion,  with  the  new  measurement  y(h),  the  updated  system  equation  for 
estimating  i(k  4- 1),  is  pven  by  a  motfified  matrix-vector  form: 

A(*  +  1)X(*+1)  +  Y(*  +  1)  (26) 

where 


U(*  +  l)  * 


■  QiU(*)  ■ 
^(*) 


and 


I  b*} 


27 

363 


lA(t  +  l)|Y(t  +  l)l  = 


R-ii 

Ria 

1 

b'l  ■ 

R-23  R» 

0 

1 

b'j 

0 

R*-i.fc-i 

1 

1 

h\.t 

R(k) 

1 

hk 

0 

0  ... 

•  •  ^ 

0 

0  0 

1 

Tl 

0 

0  ... 

0 

0  0 

1 

1 

Tk-l 

0 

0 

0 

C(k)  0 

1 

m 

0 

0  •  «  • 

0 

F(ib)  W(ib+1) 

1 

0 

To  compute  ic(li  +  1)  l>y  QR  decompoaition  on  A{k  +  1)  we  need  only  be  concerned  with 
the  fdlowing  (2n  +  m)  x  (2n  +  1)  mntiix. 


■»(*)  0  I  bfc  ■ 

C(*)  0  I  y(ib) 

[f{k)  W(ib+1)  I  0 


(27) 


as  opposed  to  the  large  A(Jb  4*  1)  matrix.  Performing  the  QE  decomposition  on  27  using 
the  orthogonal  transformation  matrix  leads  to  the  following: 


■r(*) 

0 

1  b  1 

1 

1  Vk  ■ 

Qi 

C(*) 

0 

1  m 

0 

R(k  +  1)  1 

1  b*+i 

.  F(*) 

W(*  +  l) 

1  «  . 

0 

0  1 

1  Tk 

where  and  R(A  +  1)  are  »  x  n  upper  triangular  matrices,  and  tk  is  a  residual  vector. 


SFG  Array  Design  of  Kalman  Filtm  Array  processor  designs  for  the  Kalman  filter 
have  been  proposed  in  [44],  (45),  [46|,  [43].  The  results  in  [44]  and  [45]  handle  only  the 
measurement  updating,  while  [45]  and  [43]  propoee  array  designs  both  the  measurement 
and  time  updatings.  However,  all  the  previous  methods  fril  to  exploit  the  inherent  triangular 
structure  cd  the  matrix  W(h+ 1)  in  Eq.  27.  Now  we  take  advantage  of  this  special  structure 
to  derive  a  more  efficient  SFG  design. 

Algorithm  Description  The  overall  triaagualrisatkm  procedure  consists  of  two  parts 

1.  NuUilication  ct  [6^(k)F^(k)]7'  hy  rotation  with  R(k)  in  a  QR  triarray  (see  Example 

2). 

2.  Update  W(k  + 1)  while  ret^ning  its  triangular  structure. 
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Oo  the  surface,  the  lint  step  appears  to  be  straightforward.  However,  as  shown  in 
Figure  16,  any  rotation  operatiims  applied  to  each  pair  of  rows  in  the  matrices  F(k)  and 
R(k)  are  also  applied  to  the  corresponding  pair  of  rows  in  the  matrices  W(Jb  +  1)  and  the 
zero  matrix  above  it,  denoted  by  Z(ib).  In  order  to  gnarantee  a  successful  preservation  of  the 
upper  triangular  structure  of  W(fc  +  1)  in  the  second  step,  some  processing  ordering  must 
be  adopted  when  performing  operations  on  F(k)  in  the  first  step.  This  can  be  illustrated 
by  showing  how  the  substeps  progress  and  displaying  their  snapshots  in  Figure  16.  We  note 
that  the  F(ib)  matrix  is  nnlMed  in  a  bottom  up  order,  as  shown  in  Figure  16,  hence  allowing 
W(JI;  +  1)  to  remain  upper  triangular  throughout  entire  process. 

SFG  Architecture  Design  The  above  two-step  procedure  can  be  performed  by  a  single 
QR  triarray.  The  operation  is  divided  into  two  phases:  the  procesring  on  the  C(ib)  and 
F(h)  matrices  is  performed  in  the  first  phase  (see  Figure  17(a));  while  the  processing  on 
W(h  + 1)  is  performed  in  the  second  phase  (see  Figure  17(b)).  The  processing  time  for  each 
recursion  (i.e.,  both  phases)  is  4n  +  m  (13).  The  fddlowing  describes  how  the  triarray  works: 

1.  Operation  on  C(k)t  The  new  arriving  matrix  C(ib)  can  be  nullified  by  rotating 
with  the  resident  triangular  matrix  R(h)  (see  Figure  17(a)). 

Operation  on  j'(h)}  As  shown  in  Figure  17(a),  the  nullification  on  F{k)  will  continue 
right  siter  (m  time  units)  the  operation  on  C(k)  in  a  similar  manner  in  the  triarray. 
As  discussed  in  Example  2,  a  diagonal  PE  performs  GG  (Givens  generation)  and  then 
sends  the  GR  (Givens  rotation)  parameters  right-ward  to  the  remaining  PEs  in  the 
same  row,  where  the  GRs  are  performed.  Most  importantly,  ^Tter  n  +  m  time  units, 
the  parameters  of  the  rotation  anises  (i.e.,  {  coe0ij,  nnBij  }),  start  to  emerge 
from  the  right  side  of  the  triarray  and  are  stored  in  a  data  buffer  to  be  used  for  the 
purpose  of  the  second  phase  processing. 

2.  Operation  on  W(h+1):  We  will  prove  in  a  mmnent  that,  right  after  the  nullification 
of  F{k)  is  oomplct^  at  t  w  3n  +  m,  the  matrix  W(ib  +  1)  is  already  loaded  into  the 
triarray  and  the  rotation  parameters  of  {ft^}  also  beemne  available  far  use.  Given 
what  we  have  just  claimed,  it  is  straightforward  to  perform  the  rotation  operation 
on  W(l;  -f  1)  in  a  trianay.  Note  that  the  trianay  should  now  provide  upward  and 
rightward  communication  channels,  as  oppoutd  to  the  downward  and  rightward  ones 
provided  in  the  first  phase  ptocewng. 

Rotation  Panunaton:  As  shown  in  ilguxe  18(a),  the  parameters  the  rotation 
angles,  {8t>},  mnerge  from  the  right  side  of  the  triarray  in  a  skewed  data  pattern.  The 
dsda  along  any  anti-diagonal  line  will  be  sent  to  the  same  diagonal  PE  in  the  triarray. 
A  natural  design  is  to  use  a  data  buffer  to  stine  these  parameters,  as  shown  in  Figure 
18(b),  with  the  top  row  of  the  data  buffer  directly  linked  to  to  the  diagonal  PEs  of 
the  triarray.  At  t  «  3a  +  m,  with  all  the  parameters  cd  in  place,  they  are  sent 
row  by  row  to  the  triarray  to  perform  the  Givens  rotations  on  W(ib  + 1). 
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The  overall  data  arrangements  for  the  triarray  are  displayed  in  Figure  19.  The  time 
lag  for  the  parameters  reflects  the  time  for  the  triarray  and  bufier  processing. 

Loading  W(fc+1):  As  shown  in  Figure  19,  W(b+1)  is  loaded  (from  the  top)  into  the 
triarray  immediately  after  F(Jb).  This  allows  perfect  synchrony  in  a  timely  engagement 
with  the  parameters  (from  the  left)  and  Z{k)  data  (from  the  bottom),  (see  Figure 
19). 


Solution  of  x(ft  +  1)  The  best  prediction  of  the  staite  vector  x(ib  +  1)  is  obtained  by 
solving  Eq.  25.  This  is  easily  done  using  the  back  substitution  method  on  one  additional 
linear  array  of  length  n. 

Proeeuing  Time  for  One  Recursion  There  are  two  phases  in  the  operation.  The 
first  phase  takes  3n  +  m  time  units  and  the  second  phase  tiJces  2n  time  units  to  complete 
their  respective  operations.  However,  immediately  after  n  time  units  of  the  second  phase 
processing,  P£(l,l)  becomes  free  and  can  be  used  to  start  processing  the  new  recursion  (for 
the  (h  +  l)st  stage).  Thus  the  processing  time  for  each  recursion  is  only  4n  +  m  (instead  of 
5n  +  m). 

More  daborately,  as  shown  in  Figure  19,  the  k-th  stag«  processing  starts  at  t  s  0  when 
C,ni (*)  enters  the  array,  while  the  (*  +  l)st  stags  processing  (for  Cmi (k  + 1))  can  start  right 
after  Z41  finishes  its  rotation  at  PE(1,1)  at  t  =  4n  +  m.  (Note  that  at  this  time  PE(1,2) 
will  still  be  performing  the  stage  k  computation  but  it  will  become  available  for  the  stage 
k  + 1  at  the  next  time  unit  when  Cm3  enters  the  array.)  This  amounts  to  4n  +  m  time  units 
for  procesung  one  recursion  [13]. 

5  Concluding  Remarks 

The  signal  and  image  processing  applications  generally  call  for  algorithms  which  are  de¬ 
terministic  in  both  time  and  space.  This  aUows  devdopment  of  an  unified  theoretical 
framework  for  architecture  and  algorithm  <^timixation  for  optical/VLSI  array  processors. 
Indeed,  algorUhmicaUfi  tpeeiaUzed  parallel  oompmtere  will  very  soon  become  a  dominant  and 
promising  trend  in  future  supercomputing  teclmology.  We  will  witness  the  construction  of 
an  increadng  number  of  specialised  array  processors/computers  tailored  to  execute  impor¬ 
tant  kernel  algorithms  from  signal/image  processing,  numerical  linear  algebra,  and  scientific 
computing.  Therefore,  paralld  algnithm  analysis,  design,  and  mapping  methodology  onto 
optical/VLSI  array  processors  will  have  a  vital  nde.  (Note  that  the  SFG  arrays  proposed 
here  can  be  further  mapped  to  systdic  arrays  using  the  mapping  methodology  proposed  by 
S.Y.  Kung  [18].) 

In  the  near  future,  we  will  face  the  challenge  of  modem  and  inte/l^nf  supercomputer 
systems,  which  ate  required  to  perform  perception-level  functions.  These  systems  will  be 
more  ad^>tive  to  their  environment  and  interact  with  users  in  more  natural  and  effident 
ways  through  the  integration  of  logic  circuitry  and  sensor  stimulators.  By  launching  novel 
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Figure  18:  (•)  The  perameten  of  the  roUtioii  anglee,  onerge  firom  the 
right  side  the  trisrrsy  ia  a  skewed  data  patten,  (b)  Dele  infftr  to  ston  these 
parameters,  with  the  top  row  directly  linked  to  to  the  diagonal  PEs  of  the  triarray. 
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computing  concepts  based  on  optical/VLSI  technolo^es,  these  systems  are  also  supposed  to 
solve  otherwise  un$olvcble  problems.  From  the  perspective  of  such  systems,  the  massively 
parallel  array  processors  proposed  in  this  paper  can  only  be  regarded  as  basic  primitives, 
upon  which  novd  computing  (or  thinking)  machines  are  yet  to  be  built. 
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